-- Logs begin at Thu 2022-04-28 13:22:01 UTC, end at Thu 2022-04-28 14:26:29 UTC. -- Apr 28 13:53:07.998715 dv-cinder-839760-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 28 13:53:08.006110 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 28 13:53:08 2022] *** Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: nodename: dv-cinder-839760-1-iscsi Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: machine: x86_64 Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: clock source: unix Apr 28 13:53:08.008122 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: pcre jit disabled Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: detected number of CPU cores: 4 Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: current working directory: / Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: detected binary path: /usr/bin/uwsgi-core Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: your processes number limit is 47680 Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: your memory page size is 4096 bytes Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: detected max file descriptor number: 2048 Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: lock engine: pthread robust mutexes Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: thunder lock: enabled Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 28 13:53:08.008568 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 28 13:53:08.055609 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: Python main interpreter initialized at 0x55fc9c6ef9c0 Apr 28 13:53:08.055609 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: python threads support enabled Apr 28 13:53:08.055609 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: your server socket listen backlog is limited to 100 connections Apr 28 13:53:08.055609 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: your mercy for graceful operations on workers is 90 seconds Apr 28 13:53:08.055972 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: mapped 403077 bytes (393 KB) for 2 cores Apr 28 13:53:08.056082 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: *** Operational MODE: preforking *** Apr 28 13:53:08.056364 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: *** uWSGI is running in multiple interpreter mode *** Apr 28 13:53:08.056364 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: spawned uWSGI master process (pid: 79774) Apr 28 13:53:08.056563 dv-cinder-839760-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 28 13:53:08.057301 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: spawned uWSGI worker 1 (pid: 79785, cores: 1) Apr 28 13:53:08.058545 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: spawned uWSGI worker 2 (pid: 79786, cores: 1) Apr 28 13:53:08.058545 dv-cinder-839760-1-iscsi devstack@keystone.service[79774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 28 13:53:13.786729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 13:53:13.786729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: from cryptography.utils import int_from_bytes Apr 28 13:53:13.787477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 13:53:13.787477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: from cryptography.utils import int_from_bytes Apr 28 13:53:13.787582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 13:53:13.787582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: from cryptography.utils import int_from_bytes Apr 28 13:53:13.787582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 13:53:13.787582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: from cryptography.utils import int_from_bytes Apr 28 13:53:13.837487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 28 13:53:13.837781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 28 13:53:13.837924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] command line args: [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 28 13:53:13.838018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 28 13:53:13.838156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 28 13:53:13.838248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 28 13:53:13.838311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ================================================================================ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 28 13:53:13.838377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] command line args: [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 28 13:53:13.838552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] admin_token = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.838675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 28 13:53:13.838815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ================================================================================ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 28 13:53:13.838902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config_dir = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] admin_token = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config_source = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config_dir = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] debug = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.839562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config_source = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] debug = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.843995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_config_append = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_config_append = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_dir = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_dir = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.844962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.845537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.846113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.846319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.846521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.846730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.846893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.847084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.847274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.847462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.847662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.847901 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.848067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.848263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.848501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.848702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.848866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.849112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.849280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.849280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.849682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.849682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] publish_errors = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.850029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.850220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.850457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] publish_errors = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.850629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.850792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.850929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] standard_threads = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.851990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] standard_threads = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_journal = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.852945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_json = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_stderr = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_journal = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_syslog = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_json = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.853941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_stderr = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.854194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.854941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_syslog = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.855082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.855216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 13:53:13.855353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.855487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.855615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.855749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.855877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.856789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.857867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.858953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.859881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860283 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.860924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.861886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.862908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.863890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.864928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.865885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.866928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.867055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.867181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.867316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.867451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.867580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.867713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.868921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.869094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.869328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.869493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.869734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.869975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.870652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.870877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.871079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.871250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.871516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.871717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.871944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.872120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.872350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.872517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.872709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.872900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.873097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.873289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.873514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.873738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.873904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.874129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.874295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.874458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.874638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.874813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.874958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.875959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.876933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.877067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.877196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.877352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.877530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.877744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.877882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.878818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.879862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.880924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.881984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.882905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.883983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.884896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.885968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.886111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.886252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.886381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.886509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.886656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.886848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.external = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.external = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.887984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.888134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.password = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.888264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.888392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.token = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.888600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.password = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.888732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.888876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.token = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.889947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.890872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.891938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.892870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.893974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894233 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.894889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.895958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.896796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.897936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.898997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.899927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.900990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.901620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.901767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.901897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.902947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.903872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.904919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.905899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.906956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.907884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.908942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.909886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.910946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.911971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.912881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913009 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913009 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.913820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.914997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.915916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.916045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.916173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.916311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.916441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.916577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.916706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.917414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.917546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.917711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.917844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.917974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.918893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.919028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.919156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.919293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.919423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.919552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.919930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.920985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921821 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.921961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922239 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.922957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.923998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.924923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.925858 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.926930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.927972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.928887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.929963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.930091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.930091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.930334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.930463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.930618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.930842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.931949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.932892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.933885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.934988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.935259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.936183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.936326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.936464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.936599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.936734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.936883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.937865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.938988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.939963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.940931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.941067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.941067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.941323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.941458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.941628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.941842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.942864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.943965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944453 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.944605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 13:53:13.945778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 28 13:53:13.953995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.954225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.954446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.955040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.955273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.955499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.963134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.964628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.992916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.993140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.997574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:13.997932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.046461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.047564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.097168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.097168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.097918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.098157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.162771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.162932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.163884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.187684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.187996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.188969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.189031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.189102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.189484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.200384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.200556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.215412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.215564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.215636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.215699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.215962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.216863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 13:53:14.234664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.234839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.235060 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 13:53:14.235358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 13:53:14.235464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.235581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 13:53:14.235706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.235910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 13:53:14.236176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.236350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.236448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.236623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.236708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.236871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.236964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.237135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.247782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.247932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.248058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.248205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.248335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.248472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.248616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.248749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.256866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.256995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.260195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.260362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.261042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.261195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.261291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.261461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.261543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.261752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.261836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.262874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.263041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.263122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.263285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.263375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.263539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.290474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.290569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.292141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.292232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.292417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.292501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.298017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.298247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.298400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.298640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.298727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.299055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.306485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.306766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.308647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.308930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.311404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.311687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.311959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.312229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.312494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.312761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.313024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.313285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.313439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.313752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.314035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.314317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.314593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.314868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.315141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.315412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.332587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.332860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.334606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.334884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.337397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.339945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.341618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.341912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.343580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.343873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.347037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.348973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.350650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.352565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.354357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.354654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.354929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.355204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.355474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.355746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.356238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.356537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.356823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.357108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.357386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.357688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.374851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.375129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.375389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.375652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.376754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.377035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.377301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.377585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.383491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.385195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.385986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.386141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.387714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.387989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.389137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.389412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.389720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.389999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.390291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.391179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.391459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.391737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.392014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.392300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.404178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.404457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.404734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.405008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.405282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.405667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.405990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.406744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.407022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.407302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.407584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.407863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.408228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.408506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.424581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.427249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.427846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.430540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.431169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.433454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.434423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.435112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.435386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.435659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.436160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.437826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.438112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.438393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.442957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.444547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.445700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.447315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.447754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.448079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.448471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.448756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.450577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.450870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.451258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.451534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.458121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.458403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.458675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.460738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.461027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.461306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.468019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.468299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.468579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.468851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.469120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.469267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 13:53:14.469461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.469764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.470039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.470310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.470518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.470814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.471104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.471379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.471830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.471989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.472185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.472329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.472468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.472609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.472748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.472886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.473066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.473208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.473208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.473471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.473636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.473864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 13:53:14.511116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc9c6ef9c0 pid: 79786 (default app) Apr 28 13:53:14.512553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc9c6ef9c0 pid: 79785 (default app) Apr 28 13:53:14.514514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273a3c-6b16-42ff-8ccc-b21f0aaa00b9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:14.514806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273a3c-6b16-42ff-8ccc-b21f0aaa00b9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:14.515081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273a3c-6b16-42ff-8ccc-b21f0aaa00b9 None None] PATH_INFO: `/v3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:14.519244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Apr 28 13:53:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:22.509684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab22ef-c761-42b8-89f2-f8b25a19d710 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:22.510240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab22ef-c761-42b8-89f2-f8b25a19d710 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:22.510240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab22ef-c761-42b8-89f2-f8b25a19d710 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:22.515198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:22.520559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:22.520992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:22.521263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:22.551830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG oslo_db.sqlalchemy.engines [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 28 13:53:22.746089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG passlib.handlers.bcrypt [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79786) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 28 13:53:22.746503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG passlib.handlers.bcrypt [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79786) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 28 13:53:22.803429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:22.804942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:22.925991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 28 13:53:23.066055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab22ef-c761-42b8-89f2-f8b25a19d710 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:23.099124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG oslo_db.sqlalchemy.engines [None req-31ab22ef-c761-42b8-89f2-f8b25a19d710 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 28 13:53:23.227227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab22ef-c761-42b8-89f2-f8b25a19d710 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:23.231436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:23.232103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:23.232385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:23.232656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:23.241633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:23.293949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.common.rbac_enforcer.enforcer [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 28 13:53:23.294287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db3ded-3f72-4014-a6a4-d090dbe878c3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:23.304311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Apr 28 13:53:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 13:53:23.310840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:23.324726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c6cd5-6e22-4d7a-879f-b2093d105624 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:23.328987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:23.330130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:23.330413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:23.330684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] PATH_INFO: `/v3/projects/d3a0706a2a19418486859792dfa920d5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:23.332183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] RBAC: Authorizing `identity:get_project(project_id=d3a0706a2a19418486859792dfa920d5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:23.382463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 28 13:53:23.382800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69e72-840b-4f9b-b800-ff4be735ebfc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:23.387419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Apr 28 13:53:23 2022] GET /identity/v3/projects/d3a0706a2a19418486859792dfa920d5 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:25.605936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39c46-9dae-4325-aa63-359ef23ddc57 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:25.606491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39c46-9dae-4325-aa63-359ef23ddc57 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:25.606491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39c46-9dae-4325-aa63-359ef23ddc57 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:25.610602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:25.616006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219946-76db-4491-968f-0decad442b36 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:25.616429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219946-76db-4491-968f-0decad442b36 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:25.616714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219946-76db-4491-968f-0decad442b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:25.637085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ae219946-76db-4491-968f-0decad442b36 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:25.638652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ae219946-76db-4491-968f-0decad442b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:25.646488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 28 13:53:25.669150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb39c46-9dae-4325-aa63-359ef23ddc57 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:25.681433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb39c46-9dae-4325-aa63-359ef23ddc57 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:25.686408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855b2f3-7d09-44bf-a3dc-b3e32456e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:25.687040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b2f3-7d09-44bf-a3dc-b3e32456e52a admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:25.687324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b2f3-7d09-44bf-a3dc-b3e32456e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:25.687649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b2f3-7d09-44bf-a3dc-b3e32456e52a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:25.695228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855b2f3-7d09-44bf-a3dc-b3e32456e52a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:25.696996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855b2f3-7d09-44bf-a3dc-b3e32456e52a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:25.706096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Apr 28 13:53:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 13:53:25.711650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae219946-76db-4491-968f-0decad442b36 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:25.720626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae219946-76db-4491-968f-0decad442b36 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:25.724980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879f4aa-14a8-49ca-9caf-4295d110b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:25.725872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879f4aa-14a8-49ca-9caf-4295d110b435 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:25.726159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879f4aa-14a8-49ca-9caf-4295d110b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:25.726439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879f4aa-14a8-49ca-9caf-4295d110b435 admin admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:25.727839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879f4aa-14a8-49ca-9caf-4295d110b435 admin admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:25.730234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879f4aa-14a8-49ca-9caf-4295d110b435 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:25.731822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Apr 28 13:53:25 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:28.011643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27042-9435-4408-97b5-c59a29164324 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.012205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27042-9435-4408-97b5-c59a29164324 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.012205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27042-9435-4408-97b5-c59a29164324 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.013519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:28.018458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.018883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.019023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.076709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5ff4-a549-4972-8507-733b1f71cd4a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.076992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5ff4-a549-4972-8507-733b1f71cd4a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.077270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5ff4-a549-4972-8507-733b1f71cd4a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.078905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:28.084351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.084637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.084918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.126277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG passlib.handlers.bcrypt [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79785) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 28 13:53:28.126694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG passlib.handlers.bcrypt [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79785) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 28 13:53:28.144211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:28.145422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:28.173444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:28.175024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:28.223711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:28.247116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.271256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:28.292948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.341379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974874-be27-4f97-baaf-a8aa83f217e7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.372829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.373643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.373934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.374219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.384824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:28.385158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2b7f-56ab-4da9-8292-8888e6ac729e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.392223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:28.393454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:53:28.399152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.417371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.418306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.418591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.418865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.481320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.482887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:28.491256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40829-a396-44d4-8d0e-b09356c08aa8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.523278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.523869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.524151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.524427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.525172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:28.525481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.526886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:28.538017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:28.543835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.574018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 13:53:28.579777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.635449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08889bd-52a2-4808-944d-e8a156b82457 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.667849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.668712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.668998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.669275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.670740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.671247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5118c-54c7-439a-b2dc-6229b2572cea None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.672180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:28.673798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:28.679087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.703038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.703833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.704117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.704394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.776570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77048354-081b-4cd1-8a99-469e72d81881 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.811665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.812465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.812746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.813019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.814264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.815704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:28.817340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:28.823206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.829699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.831163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:28.847837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:53:28.849053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:53:28.855128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:28.916231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712c4b-28df-41fd-abe4-2b73ace07782 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.948477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.949126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.949407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.949715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.950539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.domain.id=default, user.id=345cf70d7bbb49b087ec3309f4fef536) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:28.950846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.951868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7d4c8-cea1-4f96-b844-783d1801d44b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:28.952258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f05cc-e02e-4d76-b916-25e36573f206 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:28.958840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/role_assignments?user.id=345cf70d7bbb49b087ec3309f4fef536&scope.domain.id=default&role.id=14e44e8972ac470caeba21b91a163d08 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:28.986111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:28.986795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:28.987074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:28.987347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:28.988085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:28.988393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:28.989846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7620-f157-4c7f-98e6-8ec59220004d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:29.008323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:31.695942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b9abc-164c-4da8-a190-0bbfe1fd7f33 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:31.696457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b9abc-164c-4da8-a190-0bbfe1fd7f33 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:31.696530 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b9abc-164c-4da8-a190-0bbfe1fd7f33 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:31.698471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:31.704418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b120-7832-464d-b225-70073d69aec0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:31.704946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b120-7832-464d-b225-70073d69aec0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:31.704946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b120-7832-464d-b225-70073d69aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:31.730868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c591b120-7832-464d-b225-70073d69aec0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:31.732101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c591b120-7832-464d-b225-70073d69aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:31.812035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:31.848790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b9abc-164c-4da8-a190-0bbfe1fd7f33 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:31.942975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c89f5-175c-4da4-8c5c-937be41c816b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:31.943592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c89f5-175c-4da4-8c5c-937be41c816b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:31.944079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c89f5-175c-4da4-8c5c-937be41c816b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:31.945914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:31.951977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:31.952493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:31.952969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:31.970223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b9abc-164c-4da8-a190-0bbfe1fd7f33 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:31.997520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:31.998755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:32.047077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:32.047882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.048164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.048440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.063421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:32.065328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:32.093906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-411649ae-0ff7-4553-9967-a6ca1366b44f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:53:32.095389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 13/25] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:32.096757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669db49-75c3-433d-b2bb-feab6f82f5b9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.097241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669db49-75c3-433d-b2bb-feab6f82f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.097783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669db49-75c3-433d-b2bb-feab6f82f5b9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.100297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:32.119030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.120203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.120696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.138180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:32.139665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:32.167504 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:32.168594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:32.208707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:32.209955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:32.310929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1150-96b3-4bb5-b5f8-22a3aad2ad17 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:32.347168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:32.348311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.348817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.349288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.360558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:32.368034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:32.370435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 16/29] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:32.371492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:32.397205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64230f-1aec-440c-80f2-cf82e4f43662 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:32.474507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8a4fb-f0a3-4058-9572-d1cdb352e344 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:32.491503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:32.492184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.492467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.492747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.493530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:32.495501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:32.496925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:32.516285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 14/30] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:32.517207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:32.527582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c639b-5c60-4ba8-9250-9fd4280622ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:32.528842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c639b-5c60-4ba8-9250-9fd4280622ee None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.529290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c639b-5c60-4ba8-9250-9fd4280622ee None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.530066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c639b-5c60-4ba8-9250-9fd4280622ee None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.531236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c639b-5c60-4ba8-9250-9fd4280622ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:32.532926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c639b-5c60-4ba8-9250-9fd4280622ee None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:32.623238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c77633-6018-4583-bc12-59a20141bb83 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:32.657072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:32.658150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.658578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.658994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.659884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:32.660332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:32.661875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5220f-d694-405b-ab25-8a9d431d7bba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:32.662888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 17/31] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Apr 28 13:53:32 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:32.664691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90ae57-03f1-49f0-88c7-b8150587c261 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.665094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90ae57-03f1-49f0-88c7-b8150587c261 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.665509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90ae57-03f1-49f0-88c7-b8150587c261 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.667514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 18/32] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:32.668349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90ae57-03f1-49f0-88c7-b8150587c261 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:32.687847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 15/33] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:32.689512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.689962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.690382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.734602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:32.738953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:32.863111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90ae57-03f1-49f0-88c7-b8150587c261 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:32.891677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:32.892572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:32.907353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:32.908854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:32.909323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:32.909852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:32.910950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:32.913180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:32.952875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 19/35] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:53:32 2022] POST /identity/v3/projects => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:32.954243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:33.036124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba73fa-df57-4e0a-a581-4ea01a57f3ea None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.107506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff687f78-e644-4786-b8e6-73cae42dfb60 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.126361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2712393-5a68-4bd6-ad7a-110876437ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.127608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2712393-5a68-4bd6-ad7a-110876437ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.128128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2712393-5a68-4bd6-ad7a-110876437ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.128625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2712393-5a68-4bd6-ad7a-110876437ae9 None admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.134606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2712393-5a68-4bd6-ad7a-110876437ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.136685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2712393-5a68-4bd6-ad7a-110876437ae9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.138684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 17/36] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:32 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:33.140115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d3f2a-c8a7-4c90-bc4e-a39453e62b2b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.140548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d3f2a-c8a7-4c90-bc4e-a39453e62b2b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.140980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d3f2a-c8a7-4c90-bc4e-a39453e62b2b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.142711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 18/37] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:33.144966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.145837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.146271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.146683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.147670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.149177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afa7f4-485e-4df8-b7e7-f1f51dc09d60 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.149397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.149701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afa7f4-485e-4df8-b7e7-f1f51dc09d60 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.150084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afa7f4-485e-4df8-b7e7-f1f51dc09d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.168864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 20/38] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Apr 28 13:53:32 2022] POST /identity/v3/roles => generated 225 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:33.170355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:33.181531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d2afa7f4-485e-4df8-b7e7-f1f51dc09d60 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:33.183385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d2afa7f4-485e-4df8-b7e7-f1f51dc09d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:33.283478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:33.285179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10eb41-ed25-4379-ba56-703becf53d81 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.285470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10eb41-ed25-4379-ba56-703becf53d81 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.285814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10eb41-ed25-4379-ba56-703becf53d81 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.290054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 20/40] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:33.295779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.296202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.296606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.314916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35656e73-e9ea-4e83-8990-483724513e16 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.317207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:33.318711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:33.363198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.364027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.364315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.364600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.365957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.367453 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.370596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 21/41] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:33.372005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:33.395617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:33.396286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:33.481756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff2075-082c-4d62-b458-3cdd7dfec1a9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.504261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e510-b655-4a4e-9201-bae4bf9e8feb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.512390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.513055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.513336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.513651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.514410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.515785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.528677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Apr 28 13:53:33 2022] POST /identity/v3/roles => generated 223 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:33.529458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:33.537240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.538179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.538460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.538740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] PATH_INFO: `/v3/domains/default/users/345cf70d7bbb49b087ec3309f4fef536/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.540906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=345cf70d7bbb49b087ec3309f4fef536, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.542943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.644811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e72a-3053-4097-9026-ee50d5e2831e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.663192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Apr 28 13:53:33 2022] PUT /identity/v3/domains/default/users/345cf70d7bbb49b087ec3309f4fef536/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:53:33.680663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910fb83-2fb7-4de0-b7d6-0c2e65b66a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.681513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fb83-2fb7-4de0-b7d6-0c2e65b66a23 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.681826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fb83-2fb7-4de0-b7d6-0c2e65b66a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.682139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fb83-2fb7-4de0-b7d6-0c2e65b66a23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.683506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910fb83-2fb7-4de0-b7d6-0c2e65b66a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.685025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910fb83-2fb7-4de0-b7d6-0c2e65b66a23 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.687062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:33.693295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:33.800913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a0389-73e6-4371-ae08-f6fde5e9cf1a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:33.835298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209ba8-05db-4234-bd3d-72809adb05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:33.835983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209ba8-05db-4234-bd3d-72809adb05f4 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:33.836275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209ba8-05db-4234-bd3d-72809adb05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:33.836556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209ba8-05db-4234-bd3d-72809adb05f4 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:33.837294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209ba8-05db-4234-bd3d-72809adb05f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:33.839568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209ba8-05db-4234-bd3d-72809adb05f4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:33.872228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:53:33 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:35.906098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e73cf-4363-4606-b90e-bd92b63c2084 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:35.906613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e73cf-4363-4606-b90e-bd92b63c2084 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:35.906698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e73cf-4363-4606-b90e-bd92b63c2084 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:35.908040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:35.913355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e1af3-daa2-4cc6-b35d-9900b6f72141 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:35.913799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e1af3-daa2-4cc6-b35d-9900b6f72141 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:35.913969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e1af3-daa2-4cc6-b35d-9900b6f72141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:35.932306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-591e1af3-daa2-4cc6-b35d-9900b6f72141 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:35.933933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-591e1af3-daa2-4cc6-b35d-9900b6f72141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:36.001314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:36.024753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e73cf-4363-4606-b90e-bd92b63c2084 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.113701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce8f6-cfcf-491c-b69b-7b49d0a5ecf4 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.113998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce8f6-cfcf-491c-b69b-7b49d0a5ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.114282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce8f6-cfcf-491c-b69b-7b49d0a5ecf4 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.115664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 25/49] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:36.121156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.121450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.121771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.121880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e73cf-4363-4606-b90e-bd92b63c2084 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.137496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:36.138713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:36.152828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.153638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.153922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.154196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.163732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:36.171198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:36.172402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:36.178134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.202154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 26/51] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:36.225051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.270686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaef93-efe1-4b79-b481-4cbc5ba4f311 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.302341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.303002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.303287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.303565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.304304 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:36.304610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:36.306012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:36.313688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 26/52] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:36.319081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.324429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f56d-1756-4c39-83f9-b234588ae2f0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.356418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.357205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.357481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.357778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.358943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:36.360387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:36.362008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:36.367592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.425431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427e99-4650-48e6-b1f2-0cb047145655 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.457122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.458005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.458285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.458552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.459731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:36.461158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:36.462802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:36 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:36.464857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a88f7-c3d4-4a33-8ebb-d44962643ea7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.468141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.497811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.498479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.498768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.499049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.499769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:36.501225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:36.527693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 28/55] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Apr 28 13:53:36 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:53:36.568887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393d279-e16e-4eab-943a-5c78a1c1472c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.606554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6373d-9f8d-468c-a24f-7e082ad7a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.607395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6373d-9f8d-468c-a24f-7e082ad7a93e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.607676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6373d-9f8d-468c-a24f-7e082ad7a93e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.607978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6373d-9f8d-468c-a24f-7e082ad7a93e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.609234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6373d-9f8d-468c-a24f-7e082ad7a93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:36.610875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6373d-9f8d-468c-a24f-7e082ad7a93e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:36.612554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:36.619207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:36.728145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fee19-ab60-4be2-8859-7d005b5f94d0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:36.763171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:36.763844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:36.764132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:36.764413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:36.765258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.domain.id=default, user.id=345cf70d7bbb49b087ec3309f4fef536) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:36.765596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:36.767072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f53f92-fa6a-4c41-b9d6-efb20cc1e628 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:36.775563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Apr 28 13:53:36 2022] GET /identity/v3/role_assignments?user.id=345cf70d7bbb49b087ec3309f4fef536&scope.domain.id=default&role.id=14e44e8972ac470caeba21b91a163d08 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:38.811476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44f21-2cdd-4f57-8728-55880ddf091f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:38.812011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44f21-2cdd-4f57-8728-55880ddf091f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:38.812011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44f21-2cdd-4f57-8728-55880ddf091f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:38.813401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:38.818446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:38.818813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:38.819009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:38.835806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:38.836997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:38.898340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:38.921782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be44f21-2cdd-4f57-8728-55880ddf091f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:39.015922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be44f21-2cdd-4f57-8728-55880ddf091f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:39.046788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d168a0-cbb5-48a4-900d-2e6f5f7b7442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:39.047560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d168a0-cbb5-48a4-900d-2e6f5f7b7442 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:39.047840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d168a0-cbb5-48a4-900d-2e6f5f7b7442 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:39.048115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d168a0-cbb5-48a4-900d-2e6f5f7b7442 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:39.049273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d168a0-cbb5-48a4-900d-2e6f5f7b7442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:39.050736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d168a0-cbb5-48a4-900d-2e6f5f7b7442 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:39.052308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:39.058113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:39.149305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372db73-a9d8-4776-bcf5-893d9ecd3eab None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:39.181163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80301ff5-7489-4315-9e7c-b05447883ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:39.182409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80301ff5-7489-4315-9e7c-b05447883ab9 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:39.182691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80301ff5-7489-4315-9e7c-b05447883ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:39.182960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80301ff5-7489-4315-9e7c-b05447883ab9 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:39.183652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80301ff5-7489-4315-9e7c-b05447883ab9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:39.185081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80301ff5-7489-4315-9e7c-b05447883ab9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:39.208368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:53:39 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:42.642431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26385c-5a6a-4d8c-97d1-ea317dbbb0b1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:42.643452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26385c-5a6a-4d8c-97d1-ea317dbbb0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:42.643939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26385c-5a6a-4d8c-97d1-ea317dbbb0b1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:42.645808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:42.651459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:42.652308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:42.652786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:42.674276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:42.675777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:42.697385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a91b-ae87-4796-8187-a7169803411e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:42.698001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a91b-ae87-4796-8187-a7169803411e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:42.698479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a91b-ae87-4796-8187-a7169803411e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:42.700057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:42.717536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:42.717847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:42.719457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:42.750721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:42.752307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:42.802581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:42.830021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:42.887110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 33/65] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:42.954439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d12737-77d4-4689-8787-2ea9dceb28dc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:42.958657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:42.998142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b328-1902-45a7-b495-b67235c189e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:42.999327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b328-1902-45a7-b495-b67235c189e4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:42.999840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b328-1902-45a7-b495-b67235c189e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.000313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b328-1902-45a7-b495-b67235c189e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.012123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3b328-1902-45a7-b495-b67235c189e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:43.019372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5bf3b328-1902-45a7-b495-b67235c189e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:53:43.020840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 33/66] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:43.022324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac680-6e90-4be0-9852-4910da971841 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.022809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac680-6e90-4be0-9852-4910da971841 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.023282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac680-6e90-4be0-9852-4910da971841 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.028966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 34/67] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:43.030036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac680-6e90-4be0-9852-4910da971841 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.089193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad073f-5c7b-4f76-b4cc-3074297c4cc7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.123601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa465d2-9b40-4226-a456-c88bd24a7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.124400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa465d2-9b40-4226-a456-c88bd24a7d7b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.124683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa465d2-9b40-4226-a456-c88bd24a7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.124957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa465d2-9b40-4226-a456-c88bd24a7d7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.134582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa465d2-9b40-4226-a456-c88bd24a7d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:43.138556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac680-6e90-4be0-9852-4910da971841 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.141279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-efa465d2-9b40-4226-a456-c88bd24a7d7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:43.142496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:53:43.143649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.143960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.144187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.160253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:43.161417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:43.171237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.171926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.172220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.172499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.173242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:43.173578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.174958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae4578-1be0-4449-ae6a-3f40f70a5274 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.183134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:43.184338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301d30-3d60-4f6d-a44c-7205d25d23c7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.184628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301d30-3d60-4f6d-a44c-7205d25d23c7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.184908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301d30-3d60-4f6d-a44c-7205d25d23c7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.186323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 36/70] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:43.187227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66248470-2f00-40e4-b141-b9f81075f629 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.187823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66248470-2f00-40e4-b141-b9f81075f629 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.187823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66248470-2f00-40e4-b141-b9f81075f629 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.189124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 37/71] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:43.189709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66248470-2f00-40e4-b141-b9f81075f629 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.239994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 35/72] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:43.239994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.294047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66248470-2f00-40e4-b141-b9f81075f629 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.324659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab88ea2-65b1-4492-b664-459592f059c9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.326010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.326671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.326953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.327230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.327964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:43.328270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.329667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652743-b1d8-4e97-b971-7ece96a83e00 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.337497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:43.338578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.338865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.339142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.354354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:43.355643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:43.357802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127104-13b6-4330-bc0c-e8668aa6c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.358675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127104-13b6-4330-bc0c-e8668aa6c537 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.358955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127104-13b6-4330-bc0c-e8668aa6c537 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.359230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127104-13b6-4330-bc0c-e8668aa6c537 None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.371848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a127104-13b6-4330-bc0c-e8668aa6c537 None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.373301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a127104-13b6-4330-bc0c-e8668aa6c537 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.374980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:43.376145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.376432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.376711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.392429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:43.393630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:43.419193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:43.420517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.463690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:43.464544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.515343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a0c9-2aca-4974-98ed-2fab0fc270e7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.546804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.547603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.547885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.548156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.558214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:43.558344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebd6f-ea4a-4fca-9f88-4df190f008fa None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.565401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:53:43.566617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 40/77] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:43.571355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.589862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.590727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.591011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.591288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.592486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.593953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.595580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 38/78] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:43.596418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.658912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50043c-8a65-4f1d-a071-b50dc9fd3738 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.689397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8c29e-b078-41b3-a814-cb585c12bfa0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.690786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.691430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.691715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.691992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.720793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.721573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.721865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.722137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.723284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.724687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.726372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:43.727118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.754652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.756129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.822840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d646c-e12a-4c44-8cd6-8c68ce7bbf0f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.847355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 41/80] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:43.848189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.854803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.855597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.855885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.856163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.865881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:43.873353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:53:43.874568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 40/81] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:43.879252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.941746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60786906-6acb-4f0b-9b68-3bc58d096702 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.967602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df658d-6f54-4c17-8b13-231320bfe549 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:43.972866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:43.973529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:43.973845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:43.974118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:43.974858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:43.975165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:43.976536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:43.984910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 42/82] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:43.986439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:43.999389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.000038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.000325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.000613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.063152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.064613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.077493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281fa46-9fb8-43a6-8424-a2d8a9b57d11 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.111174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.111853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.112138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.112415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.113121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.114636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.132960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 43/83] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:53:43 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:44.133795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.162711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 41/84] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:44.162711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.255869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de990-d966-4de1-9098-349e56e184be None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.268004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbeda7-dfe1-4a58-99de-7d08b4e74e83 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.292924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.293864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.294156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.294435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.295944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.297595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.304237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 44/85] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.304237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.309601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.309779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.310009 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.310282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.311924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:44.311924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.312841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.321372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 42/86] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.322734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.414168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bac33-b5b3-4291-91bf-e1927192e774 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.435685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5acee-be65-4f73-9c73-ccab1c1e5e92 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.459655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.459655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.459910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.461603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.461603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.462938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.465157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 45/87] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.466071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.474033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.474958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.475244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.475520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.476753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.478225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.480225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 43/88] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.480840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.582233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426e65-507e-403e-91f4-fedfb00ad91b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.591241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4442-da21-46a3-957c-ae20637c856d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.615970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.616935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.617219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.617497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.618839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.620823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.626640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.626640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.641284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.642550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.643200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.643587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.644750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=a0afa88610e048a686324cd03ba538d4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:44.645433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.647050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.652770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/role_assignments?user.id=a0afa88610e048a686324cd03ba538d4&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.653780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.728529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc749c7-1cc1-4463-8c93-84b84eef87fd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.763368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.764032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.764313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.764435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96aeaa-d514-4f99-a90f-7f756d581aa6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.764845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.830812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.831498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.831786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.832069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:44.832978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=345cf70d7bbb49b087ec3309f4fef536) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:44.833310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.834812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.835895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:44.837385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:44.840966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 47/91] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/role_assignments?user.id=345cf70d7bbb49b087ec3309f4fef536&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:44.841960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:44.948570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9497e-e4b0-41ef-b726-04f768e73eab None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:44.991338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:44.991943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:44.992229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:44.992509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:45.028575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:45.034421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:45.071077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:45.072625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:45.185196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 48/93] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:45.194194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:45.254482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d52a6-0e6d-423d-bd15-0ac1a741b271 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:45.313759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85853797-0abd-4474-97ee-a4a8f755e119 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:45.338843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:45.339684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:45.339963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:45.340504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:45.346434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:45.347732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:45.349443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 46/94] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:45 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:45.351899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:45.353005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:45.354051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:45.354740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] PATH_INFO: `/v3/projects/00cd89e1742c40e482924dbabf0b29ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:45.355772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:45.356401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] RBAC: Authorizing `identity:get_project(project_id=00cd89e1742c40e482924dbabf0b29ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:45.358082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:45.360001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 49/95] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:45 2022] GET /identity/v3/projects/00cd89e1742c40e482924dbabf0b29ea => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:45.365861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:45.471823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699cb4-205e-48dc-b060-c85b5fffba6c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:45.507074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:45.508069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:45.508580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:45.509066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:45.510194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=00cd89e1742c40e482924dbabf0b29ea, user.id=a0afa88610e048a686324cd03ba538d4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:45.510743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:45.512402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826b86-ae67-4997-88be-682046feccbc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:45.519324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:45 2022] GET /identity/v3/role_assignments?user.id=a0afa88610e048a686324cd03ba538d4&scope.project.id=00cd89e1742c40e482924dbabf0b29ea&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:45.581865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af912f15-8556-4b84-9633-18faca558ffb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:45.630104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:45.630769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:45.631049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:45.631322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:45.632166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] RBAC: Adding query filter params (role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=a0afa88610e048a686324cd03ba538d4) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:45.632476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:45.633978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ebf67-ce01-4d62-a3c1-715adee9e231 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:45.645866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 47/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:45 2022] GET /identity/v3/role_assignments?user.id=a0afa88610e048a686324cd03ba538d4&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=f7fbbda498344183afd6e30baed3c90a => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:47.221107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b5faf-32ed-4fc1-bd9d-8d6024cd47ec None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.222195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b5faf-32ed-4fc1-bd9d-8d6024cd47ec None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.222714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b5faf-32ed-4fc1-bd9d-8d6024cd47ec None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:47.224310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:47.242454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.243446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.243942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:47.270539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:47.272168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:47.343740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:47.380483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b5faf-32ed-4fc1-bd9d-8d6024cd47ec None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:47.503173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b5faf-32ed-4fc1-bd9d-8d6024cd47ec None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:47.546985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:47.547810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.548096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.548373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:47.560950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:47.568121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:53:47.569758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 52/100] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:47.575416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:47.730941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0bc9f-e8ca-4b04-94a1-b35202aac31a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:47.779683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:47.780765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.781264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.781774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:47.782770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:47.783310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:47.784952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a592d2-8d24-4c00-8b90-be0b58d4c3ff None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:47.797958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 49/101] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:47.803252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:47.941195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ba75-3a7a-496d-8d44-241ddf6c4537 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:47.979045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fce4e-335a-44d7-bf67-7eb819de1786 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.979723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fce4e-335a-44d7-bf67-7eb819de1786 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.980197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fce4e-335a-44d7-bf67-7eb819de1786 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:47.981869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 50/102] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:47.990508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9ec38-d34e-4211-b7dd-8c899dedebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:47.991671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ec38-d34e-4211-b7dd-8c899dedebec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.992159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ec38-d34e-4211-b7dd-8c899dedebec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.992684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ec38-d34e-4211-b7dd-8c899dedebec None admin] PATH_INFO: `/v3/users/a12ad2ebf6da4687ac8e0afa47234c90` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:47.995998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb1dc-d747-43bf-ac86-05a752c69ef7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:47.996512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb1dc-d747-43bf-ac86-05a752c69ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:47.996998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb1dc-d747-43bf-ac86-05a752c69ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.021658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c42eb1dc-d747-43bf-ac86-05a752c69ef7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:48.023251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c42eb1dc-d747-43bf-ac86-05a752c69ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:48.031400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9ec38-d34e-4211-b7dd-8c899dedebec None admin] RBAC: Authorizing `identity:get_user(user_id=a12ad2ebf6da4687ac8e0afa47234c90)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:48.032931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9ec38-d34e-4211-b7dd-8c899dedebec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:48.034802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 53/103] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:47 2022] GET /identity/v3/users/a12ad2ebf6da4687ac8e0afa47234c90 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:48.036179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5041b4-92e2-4334-985b-4afa4c253661 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.036467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5041b4-92e2-4334-985b-4afa4c253661 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.036749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5041b4-92e2-4334-985b-4afa4c253661 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.045582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 54/104] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:48.045582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5041b4-92e2-4334-985b-4afa4c253661 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.141037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 51/105] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:48.142396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.142685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.142967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.175643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:48.176889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:48.222874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5041b4-92e2-4334-985b-4afa4c253661 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.260535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.261122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.261410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.261723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.274412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 52/106] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:48.281576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.333168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:48.335048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:48.395488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eef56-ed63-4c2d-be73-1c404d49e831 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.429598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690765ee-96d7-411b-ab83-3976dce1ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.430655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690765ee-96d7-411b-ab83-3976dce1ddcb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.431116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690765ee-96d7-411b-ab83-3976dce1ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.431570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690765ee-96d7-411b-ab83-3976dce1ddcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.432886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690765ee-96d7-411b-ab83-3976dce1ddcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:48.434511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690765ee-96d7-411b-ab83-3976dce1ddcb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:48.436295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 53/108] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:48.437857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f721-4d75-401b-a5b0-3246f8ba93be None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.438346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f721-4d75-401b-a5b0-3246f8ba93be None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.438798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f721-4d75-401b-a5b0-3246f8ba93be None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.440237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 54/109] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:48.440416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 55/109] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:48.441547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f721-4d75-401b-a5b0-3246f8ba93be None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.442908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.549807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567bed-0e3d-4385-a537-e6bd1605066d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.549984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f721-4d75-401b-a5b0-3246f8ba93be None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.583950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.584913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b0674-06c9-428f-95a7-dfb706bfcf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.585204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.585701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.585815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0674-06c9-428f-95a7-dfb706bfcf61 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.586082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0674-06c9-428f-95a7-dfb706bfcf61 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.586348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.586519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0674-06c9-428f-95a7-dfb706bfcf61 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.587576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b0674-06c9-428f-95a7-dfb706bfcf61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:48.589748 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b0674-06c9-428f-95a7-dfb706bfcf61 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:48.597681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:48.605242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:48.606540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:48.607327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.621236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 56/111] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:53:48 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:48.623150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.623773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.624063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.645942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:48.647404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:48.737336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f4cb3-4312-44d9-bfbb-5a5bdeb6b15f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.741623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 57/112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:48.742322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.795969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d6d8e-2770-4f1a-bbbb-32067e2d65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.797135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6d8e-2770-4f1a-bbbb-32067e2d65ba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.797425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6d8e-2770-4f1a-bbbb-32067e2d65ba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.797899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6d8e-2770-4f1a-bbbb-32067e2d65ba None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.799869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d6d8e-2770-4f1a-bbbb-32067e2d65ba None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:48.801476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d6d8e-2770-4f1a-bbbb-32067e2d65ba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:48.804543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 56/113] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:48 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:48.805972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15579b-6b1c-421b-b572-bf431a8c76c4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.806260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15579b-6b1c-421b-b572-bf431a8c76c4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.807155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15579b-6b1c-421b-b572-bf431a8c76c4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.809190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 57/114] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:48.809980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15579b-6b1c-421b-b572-bf431a8c76c4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:48.878924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee54ef-a650-4157-86f4-58ccec5d3e5b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.924505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.925194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.925477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.925786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.926550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:48.926863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:48.928352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d3d6a-973c-4ff2-8bfe-72a8474c98b3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:48.938650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 58/115] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:48.943500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.943500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.943500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:48.945061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15579b-6b1c-421b-b572-bf431a8c76c4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:48.959889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:48.961193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:48.986220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:48.987432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:48.987860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:48.988573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.001764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:49.011255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:53:49.017995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 58/116] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:49.018948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.032478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 59/117] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:49.033386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.131365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3324-88cc-44a7-874f-952e3cd64856 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.158470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e0be-39b8-4146-9057-bce9de409ca2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.163597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.164254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.164543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.164824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.165697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] RBAC: Adding query filter params (role.id=64314e84f5ec4320ab82b207c603eec9, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=a12ad2ebf6da4687ac8e0afa47234c90) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:49.166641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.168078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.173544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 59/118] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/role_assignments?user.id=a12ad2ebf6da4687ac8e0afa47234c90&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=64314e84f5ec4320ab82b207c603eec9 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.174366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.194361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.195425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.195806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.196179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.197688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.199327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.201328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.201328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.320285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701ce8-8d19-457c-9a99-41530930a304 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.321752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882a22b-c59c-4dd0-8e26-a053bfd1193f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.362300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3919a-6fd6-4b77-9e40-283119a25bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.363750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3919a-6fd6-4b77-9e40-283119a25bae None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.363750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3919a-6fd6-4b77-9e40-283119a25bae None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.363750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3919a-6fd6-4b77-9e40-283119a25bae None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.366131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.366131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.366617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.366902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.367665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:49.367977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.370926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.374179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3919a-6fd6-4b77-9e40-283119a25bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:49.381613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f4e3919a-6fd6-4b77-9e40-283119a25bae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:53:49.383127 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 61/120] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:49.384666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bf37-ca8e-48f1-9422-e0ae3e777bef None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.385161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bf37-ca8e-48f1-9422-e0ae3e777bef None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.385690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bf37-ca8e-48f1-9422-e0ae3e777bef None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.387392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 62/121] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:49.391741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.391741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.391944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058bf37-ca8e-48f1-9422-e0ae3e777bef None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.491560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607eb7-61de-4e46-badf-589cd0fcb271 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.498217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058bf37-ca8e-48f1-9422-e0ae3e777bef None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.526630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.527852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.528192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.528519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.529985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.532363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.534553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 61/123] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.538049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.540248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.541228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.541767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.542271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.543314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:49.544085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.545975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4c71-fdb1-43e8-8dfe-7739b9678529 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.554901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 63/124] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.556014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.556301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.556783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.576284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:49.577546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:49.646280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 64/125] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:49.647414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.684089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906777b8-5f00-4e62-aca8-9d36ff1f7e8d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.724728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.725776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.726068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.726344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.728113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.729708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.731699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.732853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.771002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e023fae-e8a1-4a06-afc2-99931e527d0d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.816941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.818377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.819198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.819707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513/users/345cf70d7bbb49b087ec3309f4fef536/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.823176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] RBAC: Authorizing `identity:create_grant(project_id=9729a3955af24edfbdeb99349fd99513, user_id=345cf70d7bbb49b087ec3309f4fef536, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.824853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.839044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ffa8d-6eec-469f-9f79-b350065d30e0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:49.843200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:53:49 2022] PUT /identity/v3/projects/9729a3955af24edfbdeb99349fd99513/users/345cf70d7bbb49b087ec3309f4fef536/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:53:49.844400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.886153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:49.887466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:49.887947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:49.888430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:49.890384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:49.892623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:49.895778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:49.901664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:49.971271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23440dfd-d1cc-471a-b637-97d9a9e91314 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.013359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.014733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.015421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.015917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.029673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:50.038461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:53:50.040271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:50.042204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:50.133581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2087e9-e845-4b65-b8da-fc3a3968fd99 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.155269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b74a8-28f3-4a38-9d8c-238b4610357c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.191967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.192828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.193105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.193380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] PATH_INFO: `/v3/projects/00cd89e1742c40e482924dbabf0b29ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.195353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=00cd89e1742c40e482924dbabf0b29ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.196818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.198737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 67/130] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:50 2022] GET /identity/v3/projects/00cd89e1742c40e482924dbabf0b29ea => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:50.199318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:50.202090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.202951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.203229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.203499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.205021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.206500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.210520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 64/131] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:49 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:50.211282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:50.347291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b69f97-a0ad-4442-890f-dbccfc13d2c8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.359581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8abb7-50ad-4b12-a548-544a8e1e8a16 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.408545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.409574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.410058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.410529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.411479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:50.412004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.413595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.423879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.425101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.425624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.426121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] PATH_INFO: `/v3/projects/00cd89e1742c40e482924dbabf0b29ea/users/a0afa88610e048a686324cd03ba538d4/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.429107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:53:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:50.430839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:50.431904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=00cd89e1742c40e482924dbabf0b29ea, user_id=a0afa88610e048a686324cd03ba538d4, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.433645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.466953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:53:50 2022] PUT /identity/v3/projects/00cd89e1742c40e482924dbabf0b29ea/users/a0afa88610e048a686324cd03ba538d4/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:53:50.468116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:50.566276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc46c-0039-434d-9766-dd1c39cbba74 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.608930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.610657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.611090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.611570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513/users/a0afa88610e048a686324cd03ba538d4/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.614058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9729a3955af24edfbdeb99349fd99513, user_id=a0afa88610e048a686324cd03ba538d4, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.615994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.631678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:53:50 2022] PUT /identity/v3/projects/9729a3955af24edfbdeb99349fd99513/users/a0afa88610e048a686324cd03ba538d4/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:53:50.677107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a10b6-f256-4767-9940-742666cd8ba3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.726961 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.727896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.728146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.728461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.729713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.731275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.732993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 66/135] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:50 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:50.740023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:50.882289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34840b6a-f4dc-4e1b-82ed-9b16298f75f1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:50.918484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613cdf-99ee-4cc3-adc5-87fe142a3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:50.919380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613cdf-99ee-4cc3-adc5-87fe142a3a94 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:50.919673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613cdf-99ee-4cc3-adc5-87fe142a3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:50.920219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613cdf-99ee-4cc3-adc5-87fe142a3a94 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:50.925622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613cdf-99ee-4cc3-adc5-87fe142a3a94 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:50.925622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613cdf-99ee-4cc3-adc5-87fe142a3a94 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:50.926549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 70/136] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:50 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:50.934735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:51.058177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d1e2-e6b4-45c1-befd-7728781973c7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:51.090677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064c99-0f5b-4f81-8e47-e70fec719902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:51.091572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064c99-0f5b-4f81-8e47-e70fec719902 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:51.091858 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064c99-0f5b-4f81-8e47-e70fec719902 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:51.092135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064c99-0f5b-4f81-8e47-e70fec719902 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513/users/a0afa88610e048a686324cd03ba538d4/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:51.094466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14064c99-0f5b-4f81-8e47-e70fec719902 None admin] RBAC: Authorizing `identity:create_grant(project_id=9729a3955af24edfbdeb99349fd99513, user_id=a0afa88610e048a686324cd03ba538d4, role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:51.096099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14064c99-0f5b-4f81-8e47-e70fec719902 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:51.123483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:53:50 2022] PUT /identity/v3/projects/9729a3955af24edfbdeb99349fd99513/users/a0afa88610e048a686324cd03ba538d4/roles/f7fbbda498344183afd6e30baed3c90a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:53:51.653787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ecbd1-cb40-4e66-8e14-e72f03e24224 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:51.653787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ecbd1-cb40-4e66-8e14-e72f03e24224 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:51.653787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ecbd1-cb40-4e66-8e14-e72f03e24224 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:51.654956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 71/138] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:51.659398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b289-78ac-4e18-b5ee-e8d062586d98 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:51.659886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b289-78ac-4e18-b5ee-e8d062586d98 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:51.660003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b289-78ac-4e18-b5ee-e8d062586d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:51.686626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1641b289-78ac-4e18-b5ee-e8d062586d98 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:51.687833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1641b289-78ac-4e18-b5ee-e8d062586d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:51.772489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:51.818438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ecbd1-cb40-4e66-8e14-e72f03e24224 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:51.842594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a500f4-3f01-4286-bffa-4491cd6c0dc7 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:51.843310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a500f4-3f01-4286-bffa-4491cd6c0dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:51.843801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a500f4-3f01-4286-bffa-4491cd6c0dc7 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:51.845677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 69/140] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:51.850605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:51.851114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:51.851611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:51.882547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:51.884085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:51.962359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ecbd1-cb40-4e66-8e14-e72f03e24224 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:51.998741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:51.999863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.000295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.000700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.002042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:52.003696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:52.005477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 72/141] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:52.014241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:52.033702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:52.077694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:52.191623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd96e7-3ab9-427b-b35a-a082dd724437 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:52.221252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119c8e-3ed1-4c8a-b008-c5191778129a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:52.237922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:52.238740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.239028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.239306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.259124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:52.266667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:53:52.267912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 71/143] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:53:52.275799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:52.289819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:52.290507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.290828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.291109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.291831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:52.293276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:52.325329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 73/144] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:53:52 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:52.419233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14805bb-748d-4249-a93e-f184083be2b6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:52.458507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:52.459193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.459480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.459760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.460525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:52.460838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:52.462295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:52.474362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 72/145] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:52.480321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:52.591264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e8685-1644-43e3-8573-a6e88a39df95 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:52.643148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:52.644042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.644330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.644609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] PATH_INFO: `/v3/users/a12ad2ebf6da4687ac8e0afa47234c90` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.645866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] RBAC: Authorizing `identity:get_user(user_id=a12ad2ebf6da4687ac8e0afa47234c90)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:52.647333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:52.649005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 74/146] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:52 2022] GET /identity/v3/users/a12ad2ebf6da4687ac8e0afa47234c90 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:52.656022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:52.809949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861725-2c87-460b-ab30-028b8691da2b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:52.847663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7803b-7acb-4f1f-95d1-4f56438c637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:52.848529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7803b-7acb-4f1f-95d1-4f56438c637f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.848812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7803b-7acb-4f1f-95d1-4f56438c637f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.849090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7803b-7acb-4f1f-95d1-4f56438c637f None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.850313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7803b-7acb-4f1f-95d1-4f56438c637f None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:52.851762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7803b-7acb-4f1f-95d1-4f56438c637f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:52.854242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 73/147] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:52 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:52.860070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:52.930478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096eaa6-464b-4760-9d87-d285b3d62f38 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.931041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096eaa6-464b-4760-9d87-d285b3d62f38 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.931560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096eaa6-464b-4760-9d87-d285b3d62f38 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.934302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 74/148] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:52.940967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:52.941475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:52.941953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:52.963554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:52.965885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:53.015565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048b2d6-9db1-476d-869a-62212759e57f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:53.078569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 75/149] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:53.080803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:53.081761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.082050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.082330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513/users/a12ad2ebf6da4687ac8e0afa47234c90/roles/64314e84f5ec4320ab82b207c603eec9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.084449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] RBAC: Authorizing `identity:create_grant(project_id=9729a3955af24edfbdeb99349fd99513, user_id=a12ad2ebf6da4687ac8e0afa47234c90, role_id=64314e84f5ec4320ab82b207c603eec9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:53.085973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:53.112463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:53:52 2022] PUT /identity/v3/projects/9729a3955af24edfbdeb99349fd99513/users/a12ad2ebf6da4687ac8e0afa47234c90/roles/64314e84f5ec4320ab82b207c603eec9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:53:53.136161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:53.265790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46188f2a-6b82-4ead-b3d3-dd9651315679 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:53.308107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:53.308918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.309203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.309479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.320547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:53.327735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:53.329415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:53.335044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:53.444369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff353a40-8d05-4f07-a051-5677ea021baf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:53.478970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:53.479715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.480008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.480288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.481046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:53.481357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:53.482768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:53.491442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 76/152] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:53.497851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:53.601446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993cc7-bc4a-46e0-88f6-8f0972cf93fd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:53.644701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fcf28-8882-4605-b02d-c61e16b6626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:53.645615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcf28-8882-4605-b02d-c61e16b6626a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.645902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcf28-8882-4605-b02d-c61e16b6626a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.646182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcf28-8882-4605-b02d-c61e16b6626a None admin] PATH_INFO: `/v3/users/345cf70d7bbb49b087ec3309f4fef536` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.647429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fcf28-8882-4605-b02d-c61e16b6626a None admin] RBAC: Authorizing `identity:get_user(user_id=345cf70d7bbb49b087ec3309f4fef536)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:53.648881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fcf28-8882-4605-b02d-c61e16b6626a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:53.650947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 77/153] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:53 2022] GET /identity/v3/users/345cf70d7bbb49b087ec3309f4fef536 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:53.656569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:53.771041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc698eeb-4825-4a0d-a355-064ab562dba1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:53.808135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:53.808806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.809097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.809382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.817020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecc797-199f-47e1-88fa-ea33737970c4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.817643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecc797-199f-47e1-88fa-ea33737970c4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.818902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecc797-199f-47e1-88fa-ea33737970c4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.821022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 78/154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:53.828678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:53.829226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:53.829739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:53.856397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:53.858100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:53.894668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:53.896216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:53.939658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 79/155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:53.966989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.000331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:54.005729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.071237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33a67-9faa-48e0-b6c0-b3e62c10d6bf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.106936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.108050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.108545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.109012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.120622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:54.128023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:53:54.129816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 80/157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:54.131336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038307-459a-417c-a4bb-7df76e72659d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.135729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.167551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.168661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.169090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.169546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.171191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:54.172801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:54.175062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 78/158] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:54.180299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.237601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b951-ce38-47b0-ae79-60afe2833d99 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.271456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.272359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.272780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.273192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.274151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:54.274598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:54.276156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:54.282186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026377-c6ad-48e2-919d-69b4861d677f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.284646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 81/159] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:54.290155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.319153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.319812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.320253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.320672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.321707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=345cf70d7bbb49b087ec3309f4fef536) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:54.322208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:54.323871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:54.330337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/role_assignments?user.id=345cf70d7bbb49b087ec3309f4fef536&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:54.393169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ebf12-5c5c-40f8-8008-ea82d7c73b84 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.428740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.429685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.429971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.430245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.431599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:54.433097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:54.435126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 82/161] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:54.440589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.571245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aea6a-4160-4fdb-9f8f-3a8914a25da2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.607973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.608640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.608924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.609198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.680170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:54.681696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:54.789126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 80/162] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:54.795812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:54.932330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af2e1-83a1-42c9-8db9-c9a75608a93b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:54.966291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fe75c-6f4b-4ba2-8e02-cb28ac73fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:54.967526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fe75c-6f4b-4ba2-8e02-cb28ac73fda2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:54.968023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fe75c-6f4b-4ba2-8e02-cb28ac73fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:54.968490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fe75c-6f4b-4ba2-8e02-cb28ac73fda2 None admin] PATH_INFO: `/v3/projects/00cd89e1742c40e482924dbabf0b29ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:54.969892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fe75c-6f4b-4ba2-8e02-cb28ac73fda2 None admin] RBAC: Authorizing `identity:get_project(project_id=00cd89e1742c40e482924dbabf0b29ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:54.971524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fe75c-6f4b-4ba2-8e02-cb28ac73fda2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:54.973757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/projects/00cd89e1742c40e482924dbabf0b29ea => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:54.980338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:55.095050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fa86a-6ab2-4d76-934d-ae914038a16a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:55.138331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:55.139392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.139872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.140343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.141369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=00cd89e1742c40e482924dbabf0b29ea, user.id=a0afa88610e048a686324cd03ba538d4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:55.141895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:55.143551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:55.149714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc41e-936b-4b6c-a163-046b50053a72 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.150803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc41e-936b-4b6c-a163-046b50053a72 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.151291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc41e-936b-4b6c-a163-046b50053a72 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.152868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 84/164] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:55.157479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:54 2022] GET /identity/v3/role_assignments?user.id=a0afa88610e048a686324cd03ba538d4&scope.project.id=00cd89e1742c40e482924dbabf0b29ea&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:55.163440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff26b9-8a48-4b96-bd77-d9646f76bdcc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.163933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff26b9-8a48-4b96-bd77-d9646f76bdcc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.164346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff26b9-8a48-4b96-bd77-d9646f76bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.183107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8dff26b9-8a48-4b96-bd77-d9646f76bdcc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:55.184613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8dff26b9-8a48-4b96-bd77-d9646f76bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:55.260429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:55.309829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:55.316438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b688339-0ef8-4c12-9667-3cfb93f82304 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.316733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b688339-0ef8-4c12-9667-3cfb93f82304 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.316992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b688339-0ef8-4c12-9667-3cfb93f82304 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.318543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 86/167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:55.324611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.324909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.325176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.350526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:55.351971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:55.481119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b200c-74e1-4402-a483-47105fe6d5ee None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:55.481293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 87/168] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:55.513021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:55.542625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:55.543480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.543766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.544045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.563979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:55.572849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:53:55.574481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 82/169] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:55.582036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:55.719110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d11b-f9d7-418f-a414-15f2f237bc10 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:55.719628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31f72-2428-42e2-abee-9f6cae383310 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:55.756208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:55.756945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.757230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.757506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.758441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:55.758760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:55.760472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:55.769661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 83/170] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:55.775621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:55.802852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:55.803907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.804368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.804788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.834484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:55.842333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:53:55.850088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 88/171] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:53:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:53:55.855951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:55.883795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d87f6a-d95f-427b-bcfb-a6190475454a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:55.922013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:55.923594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:55.924035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:55.924450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:55.925987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:55.927785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:55.929703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 84/172] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:55 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:55.938400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:56.075990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d5f7-2ae3-42b1-a322-8815d584e38f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:56.127523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328b4e-6c7a-4c7c-b88f-9aef48f835d2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:56.132150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:56.132814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:56.133140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:56.133422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:56.251207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:56.251894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:56.252178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:56.252457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:56.253226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:56.253538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:56.255007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:56.272803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 89/173] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:53:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:56.274996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:56.276476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:56.283424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:56.490463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 85/174] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:56.496102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:56.513712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee9bb9-bad5-4c9d-9602-e8910cf88a7c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:56.576639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:56.577887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:56.578368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:56.578859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] PATH_INFO: `/v3/users/a0afa88610e048a686324cd03ba538d4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:56.580798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] RBAC: Authorizing `identity:get_user(user_id=a0afa88610e048a686324cd03ba538d4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:56.582477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:56.584983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 90/175] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:56 2022] GET /identity/v3/users/a0afa88610e048a686324cd03ba538d4 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:56.590570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:56.731290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5af94-80d8-4f09-b50e-f659ce0550d1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:56.755825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676672a-c02a-4b73-9376-8f4b9c82ad75 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:56.770692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:56.771757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:56.772258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:56.772797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:56.846800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:56.847599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:56.847707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:56.847948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:56.848226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:56.849786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:56.854397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:56.855846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:56.857614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 86/176] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:56 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:56.863365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:56.956976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 91/177] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:56.963734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:57.086999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb815584-3a04-408a-b41b-a458533718ea None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:57.147728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:57.148393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.148674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.148950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.149814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=a0afa88610e048a686324cd03ba538d4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:57.150158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:57.151615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76540d-2b5d-4cb3-ac07-607c5a2068f2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:57.161998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 87/178] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:56 2022] GET /identity/v3/role_assignments?user.id=a0afa88610e048a686324cd03ba538d4&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:53:57.164818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e722-464c-4101-97fe-b04ff5d0d370 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.165108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e722-464c-4101-97fe-b04ff5d0d370 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.165390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e722-464c-4101-97fe-b04ff5d0d370 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.167294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 88/179] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:57.174878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.175165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.175430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.179921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2112f0-3013-4e09-b683-80eef6589599 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:57.200873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:57.202096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:57.266832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:57.267697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.267973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.268243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.271951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 89/180] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:57.273712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:57.275214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:57.277205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 92/181] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:56 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:57.284569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:57.354752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:57.411454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41834b28-b2d3-492f-889c-87e9e5ae9ee3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:57.447352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:57.448037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.448324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.448599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.449459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] RBAC: Adding query filter params (role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=a0afa88610e048a686324cd03ba538d4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:57.449802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:57.451376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869d509-edfc-4acd-894e-a7c7a582249d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:57.458146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 90/182] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:57 2022] GET /identity/v3/role_assignments?user.id=a0afa88610e048a686324cd03ba538d4&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=f7fbbda498344183afd6e30baed3c90a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:57.573231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76a4e8-8bc5-4f3e-8b00-d6cfdd4cb740 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:57.624021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e60b44-1b72-4652-a2cd-1505d61f8e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:57.624755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60b44-1b72-4652-a2cd-1505d61f8e90 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.625032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60b44-1b72-4652-a2cd-1505d61f8e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.625304 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60b44-1b72-4652-a2cd-1505d61f8e90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.641813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e60b44-1b72-4652-a2cd-1505d61f8e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:57.642695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107f40-b6dd-4626-9e29-9e87a764b7a6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.643177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107f40-b6dd-4626-9e29-9e87a764b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.643599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107f40-b6dd-4626-9e29-9e87a764b7a6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.645215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 91/183] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:53:57.649026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a6e60b44-1b72-4652-a2cd-1505d61f8e90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:53:57.651239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 93/184] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:57.656900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107f40-b6dd-4626-9e29-9e87a764b7a6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:57.660339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d941c0-099c-4940-835e-4e1fe718c0c7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.660460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d941c0-099c-4940-835e-4e1fe718c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.660686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d941c0-099c-4940-835e-4e1fe718c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.683923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e6d941c0-099c-4940-835e-4e1fe718c0c7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:57.685098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e6d941c0-099c-4940-835e-4e1fe718c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:57.773465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:53:57.775126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3a8c-de24-410e-91ad-92b6a835d7b7 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.775417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3a8c-de24-410e-91ad-92b6a835d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.775693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3a8c-de24-410e-91ad-92b6a835d7b7 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.777260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 95/186] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:57.782460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac58f-83fe-42b5-96db-d893200c73c0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.783220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac58f-83fe-42b5-96db-d893200c73c0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.783904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac58f-83fe-42b5-96db-d893200c73c0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.785714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 96/187] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:53:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:53:57.786707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107f40-b6dd-4626-9e29-9e87a764b7a6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:57.787255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.787702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.788296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.808583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:57.810079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:57.826226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:57.826899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.827299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.827495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.828263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:57.828572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:57.829999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43474e11-e0d6-4266-b9a9-09c0f8485c23 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:57.837970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 92/188] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:53:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:57.839166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:57.839448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:57.839720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:57.855431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:53:57.856582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:53:57.878348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 97/189] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:57.879130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:57.919244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:53:57.920339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:57.971765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c852-9380-4403-bcae-ca1c37b7f304 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.003401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.004197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.004475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.004776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.013224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbdeba-52c0-45b3-ba1c-175b5861e937 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.014323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:58.021468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:53:58.022675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 98/191] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:53:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:58.023427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.045511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.046406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.046682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.046953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] PATH_INFO: `/v3/users/a12ad2ebf6da4687ac8e0afa47234c90` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.048109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] RBAC: Authorizing `identity:get_user(user_id=a12ad2ebf6da4687ac8e0afa47234c90)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.049528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.051157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 94/192] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:57 2022] GET /identity/v3/users/a12ad2ebf6da4687ac8e0afa47234c90 => generated 289 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.051899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.122501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197835e-1fb9-448f-806e-acce730bfaab None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.144638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb422e4-d2ec-4062-80dd-df9f58dfae84 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.153864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.154647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.154938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.155211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.156377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.157842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.159457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 99/193] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.161370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.177485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.178303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.178583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.178976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.188570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:53:58.196481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:53:58.197941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 95/194] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:53:58.198716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.255002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d87e4-1867-493f-b3f4-cc157170adff None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.285964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.286619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.286898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.287167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.287903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:58.288210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.289583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.290998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c54bb-574c-45c5-8579-fa41c69e3a84 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.297333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 100/195] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.301986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.323489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.324131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.324408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.324678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.386095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.387547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.389633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911e12-3e26-4f09-846a-8697e5a34239 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.420341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.420927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.421207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.421483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.422230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.423640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.449311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 101/196] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:53:58 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:53:58.450155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.489032 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:58.489998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.555432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d9a3-7fbf-4ca9-90b0-4d666c0ff1f0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.589638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.589866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df954ec2-8cbc-48e1-af2a-bc169837876d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.590329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.590607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.590875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.591637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:58.591941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.593362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.602763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 102/198] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.604088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.624940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.625862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.626145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.626425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] PATH_INFO: `/v3/users/82259fc5d0c541ce9e22b03f007a0084` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.641389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] RBAC: Authorizing `identity:get_user(user_id=82259fc5d0c541ce9e22b03f007a0084)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.642884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.644803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/users/82259fc5d0c541ce9e22b03f007a0084 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.650003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.712242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d76b-113c-459e-bd36-6bac7b2e6ea0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.762357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.763234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.763511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.763784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.764982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.766447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.768028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37e507-f14a-439b-acce-ab7397c00082 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.768461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 103/200] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.769255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.808858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.810138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.810625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.811548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] PATH_INFO: `/v3/users/82259fc5d0c541ce9e22b03f007a0084` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.813939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] RBAC: Authorizing `identity:get_user(user_id=82259fc5d0c541ce9e22b03f007a0084)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.815375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.817196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/users/82259fc5d0c541ce9e22b03f007a0084 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.818384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.877289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795246-f42b-4c8c-b064-eaa1f5ba64b2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.911296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.911993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.912274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.912598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.928497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77e708-28d8-4c00-ba2e-0df0a9bd02d3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:58.961976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:58.963232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:58.963457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:58.963732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:58.964611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] RBAC: Adding query filter params (role.id=64314e84f5ec4320ab82b207c603eec9, scope.project.id=9729a3955af24edfbdeb99349fd99513, user.id=a12ad2ebf6da4687ac8e0afa47234c90) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:58.964924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.966402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:58.972452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 99/202] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/role_assignments?user.id=a12ad2ebf6da4687ac8e0afa47234c90&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=64314e84f5ec4320ab82b207c603eec9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:58.973079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:58.982825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:58.984377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:59.076534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f789eb-95f6-4b17-9a03-cfdb1d64e1f9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:59.088058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 104/203] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:59.098837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:59.112190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:59.112869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:59.113154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:59.113431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:59.183045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:59.184574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:59.204179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e554-8fe8-41a4-941f-a202ef9db260 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:59.239609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:59.240402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:59.240682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:59.240956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:59.242208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:59.244222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:59.246416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:59 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:59.252295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:59.286226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:53:59.293162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:59.356575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa370b9-e780-48d3-bcd2-bda076010e71 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:59.391076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:59.391738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:59.392018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:59.392286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:59.393114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] RBAC: Adding query filter params (role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=82259fc5d0c541ce9e22b03f007a0084) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:59.393423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:59.393924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a451400-fe7f-40d4-b52f-3ce2dfc5f6a0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:59.394958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:59.400853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 106/206] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:59 2022] GET /identity/v3/role_assignments?user.id=82259fc5d0c541ce9e22b03f007a0084&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=f7fbbda498344183afd6e30baed3c90a => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:59.430860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64137364-b12d-444d-a40b-4dd7e3d27709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:59.432331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64137364-b12d-444d-a40b-4dd7e3d27709 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:59.432609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64137364-b12d-444d-a40b-4dd7e3d27709 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:59.432884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64137364-b12d-444d-a40b-4dd7e3d27709 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:59.434264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64137364-b12d-444d-a40b-4dd7e3d27709 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:59.435745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64137364-b12d-444d-a40b-4dd7e3d27709 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:59.442021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:53:59 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:53:59.443937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:53:59.550570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df0e3b-d315-4271-b032-c86624b7da3c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:53:59.586642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:53:59.587354 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:53:59.587638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:53:59.587910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:53:59.588755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=82259fc5d0c541ce9e22b03f007a0084) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:53:59.589063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:53:59.590568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d8c5-9bed-4d28-b8a0-9f3d7d88a567 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:53:59.597017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:53:59 2022] GET /identity/v3/role_assignments?user.id=82259fc5d0c541ce9e22b03f007a0084&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:00.967820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad7d86-bea3-4f67-baee-c4751908d1d8 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:00.968826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad7d86-bea3-4f67-baee-c4751908d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:00.969312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad7d86-bea3-4f67-baee-c4751908d1d8 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:00.971190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:00.976778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a396d-b449-4130-b603-64b2066947b2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:00.977639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a396d-b449-4130-b603-64b2066947b2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:00.978656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a396d-b449-4130-b603-64b2066947b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:00.995737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3c7a396d-b449-4130-b603-64b2066947b2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:00.997196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3c7a396d-b449-4130-b603-64b2066947b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:01.062644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:01.075218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850fcc-b839-4f90-a748-93da226ce473 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.075768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850fcc-b839-4f90-a748-93da226ce473 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.076241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850fcc-b839-4f90-a748-93da226ce473 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.077837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 103/211] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:01.083207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.083492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.083767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.087496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850fcc-b839-4f90-a748-93da226ce473 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:01.109486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:01.110683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:01.201391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 109/212] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:01.205662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850fcc-b839-4f90-a748-93da226ce473 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:01.227635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:01.244394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:01.245202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.245478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.245809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.256120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:01.263889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:01.265478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 104/213] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:01.271122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:01.350796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ccef-8010-4524-8d07-fe9c98b6903b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:01.390524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee59b5-60dc-464b-94eb-540b13dd791b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:01.391668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:01.392455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.392881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.393289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.394613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:01.396197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:01.398315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 110/214] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:01.404322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:01.434260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:01.435852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.436333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.436746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.438132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:01.438581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:01.440668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:01.452766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 105/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:01.458319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:01.527938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c8e79-1c8d-4983-bb92-88865df61c10 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:01.560670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ebfe-6f85-4de1-850b-cbfe9f6bd018 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:01.570185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:01.571199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.571489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.571820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.572865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:01.574649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:01.597631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a36df-1353-4eeb-abf9-6c143533e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:01.599068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a36df-1353-4eeb-abf9-6c143533e2ed None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.599582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a36df-1353-4eeb-abf9-6c143533e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.600111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a36df-1353-4eeb-abf9-6c143533e2ed None admin] PATH_INFO: `/v3/users/c32e8ca55e57441fb7b9b447f3ac9158` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.605767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 111/216] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:01 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:54:01.621057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a36df-1353-4eeb-abf9-6c143533e2ed None admin] RBAC: Authorizing `identity:get_user(user_id=c32e8ca55e57441fb7b9b447f3ac9158)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:01.623431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a36df-1353-4eeb-abf9-6c143533e2ed None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:01.626287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 106/217] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:01 2022] GET /identity/v3/users/c32e8ca55e57441fb7b9b447f3ac9158 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:01.632662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:01.754862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29120b-ae14-4ad4-ae0d-c058ff25761d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:01.790986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:01.791582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.791859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.792193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.812682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9129af-ad5d-41b9-af24-aefc7b75d1d3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.812682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9129af-ad5d-41b9-af24-aefc7b75d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.812682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9129af-ad5d-41b9-af24-aefc7b75d1d3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.813546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 107/218] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:01.818952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db797a0-d2b7-4465-aa69-b8ecad682975 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.819245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db797a0-d2b7-4465-aa69-b8ecad682975 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.819526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db797a0-d2b7-4465-aa69-b8ecad682975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.837790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8db797a0-d2b7-4465-aa69-b8ecad682975 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:01.838958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8db797a0-d2b7-4465-aa69-b8ecad682975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:01.880615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:01.883620 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:01.931762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:01.933687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349823-f800-436e-acbd-caf5144f12b3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.934028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349823-f800-436e-acbd-caf5144f12b3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.934439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349823-f800-436e-acbd-caf5144f12b3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.936102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 109/220] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:01.941369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:01.941924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:01.942208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:01.958745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:01.960006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:01.992613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 112/221] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:01.993465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.031122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 110/222] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:02.032614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.115784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32566e-b76b-4775-804f-e520957f0407 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.137714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677539f5-4e6c-4efe-ab83-f61b632e0551 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.158369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.159509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.159986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.160473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.171645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:02.176797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.177702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.177987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.178264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.179958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.181305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:02.182182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.183315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 113/223] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:02.184315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.184422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 111/224] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:02.188605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.300729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039720e4-08e2-4cad-bc9a-37fd4c10ccda None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.302004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f7fb0-0592-4f68-9add-20ad04bdbf14 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.339498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.340416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.340824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.341189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.341744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.342416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.342700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.342978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.343908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:02.344488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.345953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.353103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:02.355128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 112/225] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:02.355934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.366156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:54:02.368082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 114/226] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:02.369315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.472839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7430c9-39ed-44bd-aa7e-5c7ed1867762 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.478639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90797739-738a-4f46-95e3-de53c70667f3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.505483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.506513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.506886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.507271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] PATH_INFO: `/v3/users/82259fc5d0c541ce9e22b03f007a0084` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.508557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] RBAC: Authorizing `identity:get_user(user_id=82259fc5d0c541ce9e22b03f007a0084)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.510660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.512389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 115/227] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/users/82259fc5d0c541ce9e22b03f007a0084 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:02.513188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.513985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.514273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.514556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.515401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=c32e8ca55e57441fb7b9b447f3ac9158) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:02.515716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.517606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.518129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.523588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 113/228] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/role_assignments?user.id=c32e8ca55e57441fb7b9b447f3ac9158&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:02.524315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.708201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c69e-c4c8-49a9-a0e7-99ac6fb3364b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.713693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa3bd-41c7-49ea-a047-e67bd422a6d9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.769101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.770035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.770307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.770421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.770586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.771168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.771547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.771786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.772014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.772867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:02.773247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.773357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.774902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.775068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 114/229] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:02.781634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.784607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 116/230] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:02.795086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:02.920961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d6bee-2269-44bb-9e06-c6bb0068cd28 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:02.955620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:02.956519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:02.956801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:02.957079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/82259fc5d0c541ce9e22b03f007a0084/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:02.959410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=57aedd2cc5f34328b201ec2cb1b3b18f, user_id=82259fc5d0c541ce9e22b03f007a0084, role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:02.960812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:02.977365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 115/231] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:02 2022] PUT /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/82259fc5d0c541ce9e22b03f007a0084/roles/f7fbbda498344183afd6e30baed3c90a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:02.984629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d269-1345-4396-a4c4-75d09f245616 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:03.054127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:03.055035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:03.055313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:03.055586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] PATH_INFO: `/v3/users/82259fc5d0c541ce9e22b03f007a0084` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:03.061431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] RBAC: Authorizing `identity:get_user(user_id=82259fc5d0c541ce9e22b03f007a0084)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:03.062971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:03.064755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 117/232] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:02 2022] GET /identity/v3/users/82259fc5d0c541ce9e22b03f007a0084 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:03.072164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:03.222063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58230-941e-451c-aacb-a05b067c91b5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:03.255690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91cb45-8f08-4d46-b23d-b75e114c8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:03.256563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91cb45-8f08-4d46-b23d-b75e114c8034 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:03.256844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91cb45-8f08-4d46-b23d-b75e114c8034 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:03.257118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91cb45-8f08-4d46-b23d-b75e114c8034 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:03.258326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91cb45-8f08-4d46-b23d-b75e114c8034 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:03.259789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91cb45-8f08-4d46-b23d-b75e114c8034 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:03.261808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 116/233] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:03 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:03.269509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:03.388133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa82e-5660-420e-a86d-96dfdf198c24 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:03.436860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3781-a8fd-4b41-8823-ceab5bd93dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:03.437776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3781-a8fd-4b41-8823-ceab5bd93dda None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:03.438058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3781-a8fd-4b41-8823-ceab5bd93dda None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:03.438332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3781-a8fd-4b41-8823-ceab5bd93dda None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/82259fc5d0c541ce9e22b03f007a0084/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:03.442844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c3781-a8fd-4b41-8823-ceab5bd93dda None admin] RBAC: Authorizing `identity:create_grant(project_id=57aedd2cc5f34328b201ec2cb1b3b18f, user_id=82259fc5d0c541ce9e22b03f007a0084, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:03.444291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c3781-a8fd-4b41-8823-ceab5bd93dda None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:03.469215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:03 2022] PUT /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/82259fc5d0c541ce9e22b03f007a0084/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:04.406885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cdce2-f3c5-4cad-a93f-da8aeaf0d189 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:04.407393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cdce2-f3c5-4cad-a93f-da8aeaf0d189 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:04.407496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cdce2-f3c5-4cad-a93f-da8aeaf0d189 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:04.408811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:04.418568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:04.419421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:04.420157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:04.429946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4dfe-8366-43a4-a4ba-b360f0efae8a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:04.430238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4dfe-8366-43a4-a4ba-b360f0efae8a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:04.430526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4dfe-8366-43a4-a4ba-b360f0efae8a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:04.433691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 118/236] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:04.442778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:04.443064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:04.443345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:04.447401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:04.448791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:04.474209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:04.476670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:04.553864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:04.579661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 119/238] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:04.599965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:04.617071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:04.767877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ec4d-b7c7-4f31-890f-6b332044f430 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:04.782542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc501-57fa-48d0-9a2d-174f6d57e730 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:04.828596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:04.829710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:04.831160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:04.831610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:04.833548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:04.835733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:04.837756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 120/239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:04.843343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:04.854709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:04.856119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:04.856866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:04.857317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:04.880953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:04.888281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:54:04.891097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 120/240] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:04.900758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.025735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401ec1-bad9-4b6f-a439-2fd1af058d1e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.028755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814314d-dbbe-4bc3-b5a4-9d3420bbb6d3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.066452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.067125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.067453 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.067730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.068444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.069907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.093414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 121/241] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:04 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:54:05.131516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.132230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.132516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.132792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.133583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:05.133908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.135411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799be9b-9a0d-4ea8-8a57-6a7fd82bc8a5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.156146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 121/242] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:05.162404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.166128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eddd07-c8ad-4bcb-8d34-a2fc680a6f52 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.166420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eddd07-c8ad-4bcb-8d34-a2fc680a6f52 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.166699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eddd07-c8ad-4bcb-8d34-a2fc680a6f52 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.168450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 122/243] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:05.174377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.174664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.174950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.200591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:05.202252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:05.275956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 123/244] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:05.298980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.339206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38032b4-006d-481a-84aa-7301216a5d49 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.377069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.377914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.378196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.378470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] PATH_INFO: `/v3/users/ebf8ef9d228c4348bc5de5e332d00a4a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.394269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] RBAC: Authorizing `identity:get_user(user_id=ebf8ef9d228c4348bc5de5e332d00a4a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.395759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.397929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 122/245] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/users/ebf8ef9d228c4348bc5de5e332d00a4a => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:05.405253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.415117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c7c2e-7d5e-47e0-8b94-b2a55573cea7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.458280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.459094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.459378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.459706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.472212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:05.480031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:05.481582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:05.487638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.507097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72d12-a364-4234-a2ac-32f8f2899c3b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.546523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.547628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.548053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.548624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.626044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.626238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398c2e-bc70-41de-b98d-5ce31da50e22 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.627945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.679526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.680210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.680490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.680765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.681616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:05.681899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.683293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.696440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 125/247] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:05.702563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.748640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 123/248] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:05.754577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.812087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcedd9-bdaa-4403-a3ea-be632f37e0e6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.846705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.847837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.848264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.848723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] PATH_INFO: `/v3/users/c32e8ca55e57441fb7b9b447f3ac9158` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.850165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] RBAC: Authorizing `identity:get_user(user_id=c32e8ca55e57441fb7b9b447f3ac9158)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.851804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.854100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 126/249] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/users/c32e8ca55e57441fb7b9b447f3ac9158 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:05.857328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0a4e2-ae43-4299-a2f1-72290cedc930 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:05.862630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:05.902939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7aba-81cd-4b0e-98eb-0b6346d0d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:05.903815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7aba-81cd-4b0e-98eb-0b6346d0d80d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.904806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7aba-81cd-4b0e-98eb-0b6346d0d80d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.904806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7aba-81cd-4b0e-98eb-0b6346d0d80d None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.905548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7aba-81cd-4b0e-98eb-0b6346d0d80d None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:05.907044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7aba-81cd-4b0e-98eb-0b6346d0d80d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:05.908922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 124/250] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:05.910533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693312e0-f467-4a1c-9ac8-4473c9a8cf10 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.910533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693312e0-f467-4a1c-9ac8-4473c9a8cf10 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.910533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693312e0-f467-4a1c-9ac8-4473c9a8cf10 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.911930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 125/251] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:05.917089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:05.917370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:05.917712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:05.936834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:05.938063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:05.985986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6372486-d73f-4483-833f-1dd65e3434e3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.009943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 126/252] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:06.010814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:06.042438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.043317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.043600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.043876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.045326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:06.046802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:06.048799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 127/253] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:05 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:06.049587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:06.141141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec00df-2f49-4bed-aef2-e01c40f8fd52 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.160247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104941-9d60-4e6f-8363-bdb1c146fd00 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.176374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.177035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.177317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.177612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.178450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] RBAC: Adding query filter params (role.id=64314e84f5ec4320ab82b207c603eec9, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=ebf8ef9d228c4348bc5de5e332d00a4a) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:06.178761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:06.180365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:06.186862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 127/254] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:06 2022] GET /identity/v3/role_assignments?user.id=ebf8ef9d228c4348bc5de5e332d00a4a&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=64314e84f5ec4320ab82b207c603eec9 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:06.187479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:06.195963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.196907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.197191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.197462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.209006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:06.216759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:06.218416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 128/255] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:06.224247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:06.297679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321efc-d043-42c4-a908-9bfa43319427 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.336410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.337389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.337719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.337994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/c32e8ca55e57441fb7b9b447f3ac9158/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.340146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=57aedd2cc5f34328b201ec2cb1b3b18f, user_id=c32e8ca55e57441fb7b9b447f3ac9158, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:06.341094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3014b7-ea93-41fb-b984-bed9a320b192 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.341613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:06.369126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 128/256] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:06 2022] PUT /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/c32e8ca55e57441fb7b9b447f3ac9158/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:06.391773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.392449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.392725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.393048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.393824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:06.394181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:06.395727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:06.406489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 129/257] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:06.412887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:06.566603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f6fe-10a2-4010-8ee1-b560cfc8d3c7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.613052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d9d8-a903-454e-9c4b-0a727cc61a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.614335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d9d8-a903-454e-9c4b-0a727cc61a64 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.614832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d9d8-a903-454e-9c4b-0a727cc61a64 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.615317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d9d8-a903-454e-9c4b-0a727cc61a64 None admin] PATH_INFO: `/v3/users/82259fc5d0c541ce9e22b03f007a0084` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.617193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d9d8-a903-454e-9c4b-0a727cc61a64 None admin] RBAC: Authorizing `identity:get_user(user_id=82259fc5d0c541ce9e22b03f007a0084)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:06.619503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d9d8-a903-454e-9c4b-0a727cc61a64 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:06.621907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 129/258] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:06 2022] GET /identity/v3/users/82259fc5d0c541ce9e22b03f007a0084 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:06.627191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:06.766247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287bd4-0324-4ca5-959d-e4aa124a2628 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:06.810813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:06.811824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.812340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.812844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.842911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48fd79-9007-4117-b00e-0ea5ed12a91a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.843508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48fd79-9007-4117-b00e-0ea5ed12a91a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.843979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48fd79-9007-4117-b00e-0ea5ed12a91a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.845880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 130/259] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:06.854123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:06.854424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:06.854704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:06.888030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:06.890967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:06.912195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:06.915694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:07.024698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 131/260] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:07.059567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:07.062899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 130/261] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:07.068099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:07.182024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbeaf0-7a59-4a3c-8605-e9937e24489d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:07.220535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5bb4-0d54-45f9-97f1-2530c3b56026 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:07.224832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:07.225976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:07.226474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:07.226948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:07.233203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:07.234924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:07.236919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 131/262] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:07 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:07.242519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:07.324348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:07.324348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:07.324348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:07.324348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:07.370234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:07.377246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:54:07.378653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186ac7-f735-44b5-a6d8-75be287477b5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:07.378910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 132/263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:07.384291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:07.420868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:07.421954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:07.422488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:07.422962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:07.423987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] RBAC: Adding query filter params (role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=82259fc5d0c541ce9e22b03f007a0084) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:07.424517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:07.426278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:07.437911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 132/264] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:07 2022] GET /identity/v3/role_assignments?user.id=82259fc5d0c541ce9e22b03f007a0084&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=f7fbbda498344183afd6e30baed3c90a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:07.537770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0702930-2802-4977-b76e-08d1f3bda9f0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:07.577325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:07.578021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:07.578302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:07.578580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:07.579348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:07.579657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:07.581052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:07.595023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 133/265] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:07.596373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:07.761320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6f04b-859f-4f66-bff6-9222365562e3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:07.807786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:07.809084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:07.809577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:07.810047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] PATH_INFO: `/v3/users/82259fc5d0c541ce9e22b03f007a0084` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:07.814279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] RBAC: Authorizing `identity:get_user(user_id=82259fc5d0c541ce9e22b03f007a0084)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:07.815981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:07.818203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 133/266] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:07 2022] GET /identity/v3/users/82259fc5d0c541ce9e22b03f007a0084 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:07.823865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:07.945533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb8c1-f76b-48e2-b91e-e713504f3d1c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:07.985141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:07.985829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:07.986114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:07.986391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.091031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:08.092415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:08.214631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 134/267] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:08.219875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:08.366693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ca5e-2300-47ab-939a-b89d6dda0846 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:08.423974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01b698-6e8a-4447-9967-9f095d80555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:08.424836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b698-6e8a-4447-9967-9f095d80555f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:08.425113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b698-6e8a-4447-9967-9f095d80555f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:08.425384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b698-6e8a-4447-9967-9f095d80555f None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.430265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01b698-6e8a-4447-9967-9f095d80555f None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:08.432269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01b698-6e8a-4447-9967-9f095d80555f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:08.434313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 134/268] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:08 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:08.440102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:08.561141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0f42-b73e-4ba5-b400-2587873b5178 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:08.601139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:08.602065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:08.602370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:08.602544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.604038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=82259fc5d0c541ce9e22b03f007a0084) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:08.604354 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:08.605954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15084e25-4169-4fa7-8207-dac47c17ec97 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:08.613174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 135/269] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:08 2022] GET /identity/v3/role_assignments?user.id=82259fc5d0c541ce9e22b03f007a0084&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:08.780794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4b48-3825-4c52-a24f-b5184ca36ebd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:08.781494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4b48-3825-4c52-a24f-b5184ca36ebd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:08.781494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4b48-3825-4c52-a24f-b5184ca36ebd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.782739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 135/270] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:08.788372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97224-e144-42de-8553-94d0b46fcb78 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:08.788660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97224-e144-42de-8553-94d0b46fcb78 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:08.788942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97224-e144-42de-8553-94d0b46fcb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.812753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9da97224-e144-42de-8553-94d0b46fcb78 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:08.814012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9da97224-e144-42de-8553-94d0b46fcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:08.893251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 136/271] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:08.918030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4b48-3825-4c52-a24f-b5184ca36ebd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:08.938397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebf381-9c52-4218-919d-3dc69f8a127a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:08.938683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebf381-9c52-4218-919d-3dc69f8a127a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:08.938962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebf381-9c52-4218-919d-3dc69f8a127a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.940479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 137/272] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:08.945832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:08.946124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:08.946974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:08.963271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:08.964467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:09.044326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 138/273] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:09.058969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4b48-3825-4c52-a24f-b5184ca36ebd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.075215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.110892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.111706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.111986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.112258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.113456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:09.114929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:09.116745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 136/274] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:09.124981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.195992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b9ac4-0f42-4e24-814a-e258c9e13ad5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.230374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e685a-bfc6-401d-a6d3-2c01657996b3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.231153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.232169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.232685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.233165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.244548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:09.251825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:09.253436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 139/275] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:09.259961 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.270109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114c1a1-7a6f-4aab-b7af-98166fbc9265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.271529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114c1a1-7a6f-4aab-b7af-98166fbc9265 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.272050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114c1a1-7a6f-4aab-b7af-98166fbc9265 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.272547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114c1a1-7a6f-4aab-b7af-98166fbc9265 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.273876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114c1a1-7a6f-4aab-b7af-98166fbc9265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:09.276219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114c1a1-7a6f-4aab-b7af-98166fbc9265 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:09.308418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 137/276] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:09 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:54:09.347720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038daae-4cff-4af0-93df-22dd1db76483 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.347720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038daae-4cff-4af0-93df-22dd1db76483 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.347720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038daae-4cff-4af0-93df-22dd1db76483 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.348942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 138/277] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:09.355993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.356283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.356601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.374574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:09.375811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:09.378100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff2760-a4dc-44ba-8b75-26bceb3c0bec None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.424321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.425964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.426481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.426972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.428381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:09.428909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:09.431257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:09.444427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 140/278] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:09.450601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.469899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 139/279] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:09.484495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.557631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912676-95be-418e-8bf4-da65aada0b0d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.600199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.601053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.601365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.601929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] PATH_INFO: `/v3/users/723949463152462a897cb0910a9528d5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.607662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56708e4a-d114-4b7c-b767-c3e4a90d27b5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.621363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] RBAC: Authorizing `identity:get_user(user_id=723949463152462a897cb0910a9528d5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:09.623241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:09.625178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 141/280] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/users/723949463152462a897cb0910a9528d5 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:09.631490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.656534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.657337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.657650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.657916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.674288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:09.684002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:54:09.686595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 140/281] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:09.693528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.746514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b00e-c062-4e4c-96b3-986ebb5f2031 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.780548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.781204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.781482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.781778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.782612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, user.id=723949463152462a897cb0910a9528d5, scope.system=all) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:09.782921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:09.784359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a34e-5a10-4be0-9161-1121e67f27e3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:09.789859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 142/282] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/role_assignments?user.id=723949463152462a897cb0910a9528d5&scope.system=all&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:09.791809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235f7d-956e-488a-91a7-81e698901db5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.792099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235f7d-956e-488a-91a7-81e698901db5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.792378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235f7d-956e-488a-91a7-81e698901db5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.793864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 143/283] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:09.799688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.800016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.800246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.811101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dff67-855e-4acd-a4d7-395f2a778c21 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:09.818388 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:09.819589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:09.845827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:09.846506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:09.846782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:09.847052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:09.847805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:09.848104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:09.849482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:09.859731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 141/284] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:09.865183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.890052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 144/285] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:09.915752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:09.969257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187804-864b-47b8-abb3-17e45bbb564e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.002837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.003832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.004117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.004386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] PATH_INFO: `/v3/users/ebf8ef9d228c4348bc5de5e332d00a4a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.005682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf8ef9d228c4348bc5de5e332d00a4a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.007156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.009708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 142/286] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/users/ebf8ef9d228c4348bc5de5e332d00a4a => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:10.015179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:10.017877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338b232-caac-4972-b6c0-b0ae1417d441 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.052556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.053366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.053674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.053948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.065264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:10.072885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:10.074483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 145/287] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:10.080275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:10.119655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506f9a-104a-4a60-94bd-b4e719812b14 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.154269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.155143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.155422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.155691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.156885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.158342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.160346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 143/288] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:10 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:10.170732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:10.199533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77614e-5ff9-4369-b12b-d2a918f70caa None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.238114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.238785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.239060 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.239327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.240239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:10.240543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.242566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.257179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 146/289] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:10.258626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:10.287301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068a7e-1db2-4ebf-a839-e61ba5054847 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.330617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.331129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.331409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.331682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/ebf8ef9d228c4348bc5de5e332d00a4a/roles/64314e84f5ec4320ab82b207c603eec9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.333713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] RBAC: Authorizing `identity:create_grant(project_id=57aedd2cc5f34328b201ec2cb1b3b18f, user_id=ebf8ef9d228c4348bc5de5e332d00a4a, role_id=64314e84f5ec4320ab82b207c603eec9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.335711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.360099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 144/290] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:10 2022] PUT /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/users/ebf8ef9d228c4348bc5de5e332d00a4a/roles/64314e84f5ec4320ab82b207c603eec9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:10.366607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a22b-a919-4447-88c0-e9bfa0ce4b5b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.404601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.405499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.405813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.406096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] PATH_INFO: `/v3/users/c32e8ca55e57441fb7b9b447f3ac9158` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.407411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] RBAC: Authorizing `identity:get_user(user_id=c32e8ca55e57441fb7b9b447f3ac9158)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.408913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.411160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 147/291] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:10 2022] GET /identity/v3/users/c32e8ca55e57441fb7b9b447f3ac9158 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:10.418818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:10.548252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfb92-5094-4c6c-831d-7e4ffc9eb8da None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.583471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.584145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.584430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.584708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.669657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.671360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.777115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 145/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:10.782424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:10.914508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348ce0e-401c-4956-bb9a-006260679958 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:10.948284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612e2c-7f26-438d-80c5-ddc2ec66d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:10.949059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612e2c-7f26-438d-80c5-ddc2ec66d26d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:10.949335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612e2c-7f26-438d-80c5-ddc2ec66d26d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:10.949637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612e2c-7f26-438d-80c5-ddc2ec66d26d None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:10.950814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3612e2c-7f26-438d-80c5-ddc2ec66d26d None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:10.952246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3612e2c-7f26-438d-80c5-ddc2ec66d26d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:10.954258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 148/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:10 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:10.960103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:11.068847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374a1bf-97dd-43a5-93c0-37eadb56f846 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:11.126369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:11.127030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:11.127309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:11.127583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:11.128418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=c32e8ca55e57441fb7b9b447f3ac9158) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:11.128731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:11.130203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096938ec-7412-4b2a-9fa3-b609167a835d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:11.141841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 146/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:10 2022] GET /identity/v3/role_assignments?user.id=c32e8ca55e57441fb7b9b447f3ac9158&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:12.024396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12fcb-aaf7-4974-86e3-65cfd3e1eb70 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.025098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12fcb-aaf7-4974-86e3-65cfd3e1eb70 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.025098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12fcb-aaf7-4974-86e3-65cfd3e1eb70 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.026357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 149/295] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:12.031555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cfad-b30e-47a1-8b28-697d825a5bbc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.032050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cfad-b30e-47a1-8b28-697d825a5bbc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.032205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cfad-b30e-47a1-8b28-697d825a5bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.049448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a2c4cfad-b30e-47a1-8b28-697d825a5bbc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:12.050664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a2c4cfad-b30e-47a1-8b28-697d825a5bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:12.127954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 147/296] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:12.150923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12fcb-aaf7-4974-86e3-65cfd3e1eb70 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.179583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21072-0fee-47cf-a6cb-f03db8c4ef2b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.179877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21072-0fee-47cf-a6cb-f03db8c4ef2b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.180153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21072-0fee-47cf-a6cb-f03db8c4ef2b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.183393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 148/297] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:12.187552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.187838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.188122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.204190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:12.205376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:12.253413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12fcb-aaf7-4974-86e3-65cfd3e1eb70 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.281732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 149/298] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:12.287507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.288299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.288580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.288852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.299758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:12.300805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.307308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:54:12.308790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 150/299] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:12.314284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.402550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129c6a-a983-4e78-91a9-e10140f49eb2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.412173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b22cc-bbdc-4b06-a95a-f6246978aeaf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.437696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.438923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.439416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.439896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.441431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:12.443269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:12.450798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 150/300] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:12.451568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.452288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.452571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.452850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.453392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.453684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:12.453996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:12.455434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:12.470413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 151/301] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:12.471427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.574261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec8a4-e824-447c-83c0-7ac2b7d792c5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.586535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc8ff-510a-4f5d-a8b6-5129fbd268c1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.620667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.621829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.622292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8325778-6ed7-453b-85e9-9cfc4218903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.622521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.622970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] PATH_INFO: `/v3/groups` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.623376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8325778-6ed7-453b-85e9-9cfc4218903d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.623721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8325778-6ed7-453b-85e9-9cfc4218903d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.624066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8325778-6ed7-453b-85e9-9cfc4218903d None admin] PATH_INFO: `/v3/users/ee6e0541ab7142a4b9fc0e1eab5f4f96` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.624406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:12.626426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:12.640128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8325778-6ed7-453b-85e9-9cfc4218903d None admin] RBAC: Authorizing `identity:get_user(user_id=ee6e0541ab7142a4b9fc0e1eab5f4f96)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:12.641644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8325778-6ed7-453b-85e9-9cfc4218903d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:12.643527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 152/302] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/users/ee6e0541ab7142a4b9fc0e1eab5f4f96 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:12.644576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe1b9-c6ab-4e1f-8637-5200ab6bfb89 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.644859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe1b9-c6ab-4e1f-8637-5200ab6bfb89 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.650940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe1b9-c6ab-4e1f-8637-5200ab6bfb89 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.651112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 151/303] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Apr 28 13:54:12 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:54:12.651229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 153/304] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:12.658868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.659365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.659655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.659937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.683972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:12.685475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:12.773307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9738ea7-b683-4c76-8ff6-756c3a147e29 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.779028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 154/305] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:12.807588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:12.826222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.827267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.827764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.828239 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.829952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] RBAC: Adding query filter params (role.id=64314e84f5ec4320ab82b207c603eec9, user.id=ee6e0541ab7142a4b9fc0e1eab5f4f96, scope.system=all) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:12.830575 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:12.832758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:12.839922 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 152/306] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/role_assignments?user.id=ee6e0541ab7142a4b9fc0e1eab5f4f96&scope.system=all&role.id=64314e84f5ec4320ab82b207c603eec9 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:12.919977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109b534-7ccb-4a14-b471-602bb0d10aca None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:12.957037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:12.958269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:12.958747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:12.959211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:12.970623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:12.978714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:12.980433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 155/307] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:12.986840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:13.090722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e5d5-44c4-46cb-997d-ea9fe12d71d2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:13.129567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:13.130271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.130552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.130827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.131590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:13.131897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:13.133328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:13.142967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 153/308] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:13.148443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:13.248422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7558c-d52d-4436-8e0e-088879071ec5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:13.281759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0b079-7a27-4a08-8291-347be7de0e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:13.282630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0b079-7a27-4a08-8291-347be7de0e90 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.282909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0b079-7a27-4a08-8291-347be7de0e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.283181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0b079-7a27-4a08-8291-347be7de0e90 None admin] PATH_INFO: `/v3/users/723949463152462a897cb0910a9528d5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.284366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0b079-7a27-4a08-8291-347be7de0e90 None admin] RBAC: Authorizing `identity:get_user(user_id=723949463152462a897cb0910a9528d5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:13.285819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0b079-7a27-4a08-8291-347be7de0e90 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:13.287747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 156/309] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:13 2022] GET /identity/v3/users/723949463152462a897cb0910a9528d5 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:13.293311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:13.304134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373af902-b694-4f60-a8db-f2bf6dc1d2e1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.304426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373af902-b694-4f60-a8db-f2bf6dc1d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.304705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373af902-b694-4f60-a8db-f2bf6dc1d2e1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.306904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 157/310] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:13.311979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.312267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.312552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.329312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:13.330538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:13.401679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 158/311] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:13.410316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c921c-fbfb-449d-9ab3-8f594147289c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:13.418495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:13.454261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:13.456027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.456314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.456594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] PATH_INFO: `/v3/system/users/723949463152462a897cb0910a9528d5/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.458145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=723949463152462a897cb0910a9528d5, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:13.459519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:13.470971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Apr 28 13:54:13 2022] PUT /identity/v3/system/users/723949463152462a897cb0910a9528d5/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:13.533688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9546-fdbb-4af3-827e-458759813116 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:13.574372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:13.575317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.575601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.575920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.587958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:13.595330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:54:13.596743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:13.603747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:13.714472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d82789-bbf2-42a4-a623-3348594bc30c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:13.748781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:13.749457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.749770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.750045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.750796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:13.751102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:13.752469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:13.761164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:13.766547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:13.871247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43befbfe-faaf-4525-8a17-1f3007779ad0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:13.907515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:13.908418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:13.908703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:13.908980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] PATH_INFO: `/v3/users/ebf8ef9d228c4348bc5de5e332d00a4a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:13.910268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf8ef9d228c4348bc5de5e332d00a4a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:13.911813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:13.917673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:13 2022] GET /identity/v3/users/ebf8ef9d228c4348bc5de5e332d00a4a => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:13.920365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:14.022391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e224d-0dfd-4637-bcd1-44bc94b890e7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:14.057091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:14.057768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:14.058054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:14.058330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:14.124333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:14.125819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:14.223710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:14.229624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:14.332582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a742-ac68-4243-9fed-36dc53ac77b4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:14.366127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a062b-25a3-4084-aa3a-a67c67209bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:14.366993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a062b-25a3-4084-aa3a-a67c67209bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:14.367277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a062b-25a3-4084-aa3a-a67c67209bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:14.367554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a062b-25a3-4084-aa3a-a67c67209bb2 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:14.369296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a062b-25a3-4084-aa3a-a67c67209bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:14.370787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a062b-25a3-4084-aa3a-a67c67209bb2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:14.377407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:14 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:14.379021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:14.476271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d736b6-140e-4b8b-a5eb-b6e77457c13b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:14.511850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:14.512519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:14.512799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:14.513079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:14.513958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] RBAC: Adding query filter params (role.id=64314e84f5ec4320ab82b207c603eec9, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f, user.id=ebf8ef9d228c4348bc5de5e332d00a4a) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:14.514275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:14.515722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d092b0-e35b-4982-ab94-5fb22edccf95 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:14.525669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:14 2022] GET /identity/v3/role_assignments?user.id=ebf8ef9d228c4348bc5de5e332d00a4a&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=64314e84f5ec4320ab82b207c603eec9 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:15.039010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26489c33-9005-4398-9a17-6b94fab5685b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.039405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26489c33-9005-4398-9a17-6b94fab5685b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.039672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26489c33-9005-4398-9a17-6b94fab5685b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.041758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 162/319] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:15.046861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ac7d-0063-4263-840f-32315f17c68d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.047148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ac7d-0063-4263-840f-32315f17c68d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.047416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ac7d-0063-4263-840f-32315f17c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.063917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-88c0ac7d-0063-4263-840f-32315f17c68d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:15.065076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-88c0ac7d-0063-4263-840f-32315f17c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:15.133925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:15.156011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26489c33-9005-4398-9a17-6b94fab5685b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.187309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21731db-9436-47cd-a72b-7ea5ee7591f9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.187600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21731db-9436-47cd-a72b-7ea5ee7591f9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.187875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21731db-9436-47cd-a72b-7ea5ee7591f9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.189246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 159/321] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:15.194341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.194628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.194897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.210654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:15.211816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:15.256779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26489c33-9005-4398-9a17-6b94fab5685b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:15.277704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 160/322] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:15.288252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f800da-4c31-4681-a43b-842763028674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:15.289174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f800da-4c31-4681-a43b-842763028674 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.289456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f800da-4c31-4681-a43b-842763028674 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.290502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f800da-4c31-4681-a43b-842763028674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.291712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f800da-4c31-4681-a43b-842763028674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:15.293205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f800da-4c31-4681-a43b-842763028674 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:15.295202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 163/323] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:15.298206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.300572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f800da-4c31-4681-a43b-842763028674 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.397324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f800da-4c31-4681-a43b-842763028674 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:15.401094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb679a-3000-4dcc-8a9a-4ffbd9db0fc1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:15.430305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:15.430997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.431276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.431548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] PATH_INFO: `/v3/groups` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.432229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:15.433678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:15.434481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:15.435269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.435545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.435944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.447114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:15.449158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 164/324] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Apr 28 13:54:15 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:54:15.454689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:54:15.456145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 161/325] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:15.462895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.585710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038df00-1bc6-4583-a5b3-34489cf53867 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:15.625647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:15.626513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.626865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.627212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.628053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:15.628448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:15.630026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e8417-48b3-4ea0-936f-c1da19c38719 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:15.641609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 165/326] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:15.651454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.776758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6812-9a91-4bf2-b66c-876fc801f325 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.778140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6812-9a91-4bf2-b66c-876fc801f325 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.779512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6812-9a91-4bf2-b66c-876fc801f325 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.779793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09204e-5cb9-46b9-b6df-c6f248a0cf00 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:15.781236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 166/327] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:15.787233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.787516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.787684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.812068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:15.813292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:15.831518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:15.834037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:15.834527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:15.834999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] PATH_INFO: `/v3/users/ee6e0541ab7142a4b9fc0e1eab5f4f96` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:15.838358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] RBAC: Authorizing `identity:get_user(user_id=ee6e0541ab7142a4b9fc0e1eab5f4f96)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:15.840089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:15.843818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 162/328] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:15 2022] GET /identity/v3/users/ee6e0541ab7142a4b9fc0e1eab5f4f96 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:15.849614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.906184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 167/329] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:15.934555 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:15.991899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833411b5-abf5-4167-923f-09f6a15f4b70 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:16.031249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:16.032116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:16.032396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:16.032671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] PATH_INFO: `/v3/system/users/ee6e0541ab7142a4b9fc0e1eab5f4f96/roles/64314e84f5ec4320ab82b207c603eec9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:16.034180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ee6e0541ab7142a4b9fc0e1eab5f4f96, role_id=64314e84f5ec4320ab82b207c603eec9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:16.035561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:16.044272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 163/330] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Apr 28 13:54:15 2022] PUT /identity/v3/system/users/ee6e0541ab7142a4b9fc0e1eab5f4f96/roles/64314e84f5ec4320ab82b207c603eec9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:16.074644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470ba63-68b3-45c9-a83c-457f041834c1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:16.115302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:16.116128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:16.116407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:16.116680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:16.129693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:16.136993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:16.138729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 168/331] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:16.144752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:16.254670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571d7f-dd90-488d-92ba-f99ddf7dd33f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:16.288791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:16.289515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:16.289852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:16.290136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:16.290883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:16.291186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:16.292562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:16.301347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 164/332] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:16.307433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:16.414880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223aece-1399-4587-b8d5-05e67b791349 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:16.449235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33114-b4b3-4d36-be34-29a4d9a474c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:16.450145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33114-b4b3-4d36-be34-29a4d9a474c2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:16.450421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33114-b4b3-4d36-be34-29a4d9a474c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:16.450688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33114-b4b3-4d36-be34-29a4d9a474c2 None admin] PATH_INFO: `/v3/users/723949463152462a897cb0910a9528d5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:16.451897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff33114-b4b3-4d36-be34-29a4d9a474c2 None admin] RBAC: Authorizing `identity:get_user(user_id=723949463152462a897cb0910a9528d5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:16.453345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff33114-b4b3-4d36-be34-29a4d9a474c2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:16.455300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 169/333] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:16 2022] GET /identity/v3/users/723949463152462a897cb0910a9528d5 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:16.461155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:16.588392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462c09b-f06c-4a2d-9d59-c5ed653298a7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:16.626881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:16.627542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:16.627829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:16.628104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:16.628934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] RBAC: Adding query filter params (role.id=ebb9c3282d21483bba8630dd78798d6b, user.id=723949463152462a897cb0910a9528d5, scope.system=all) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:16.629246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:16.630787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd00c6-c7a2-4b13-bf8a-4af24240315b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:16.647035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 165/334] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Apr 28 13:54:16 2022] GET /identity/v3/role_assignments?user.id=723949463152462a897cb0910a9528d5&scope.system=all&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:18.519308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf774b-baef-44f4-9b1e-17df61c4202f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:18.520364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf774b-baef-44f4-9b1e-17df61c4202f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:18.520864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf774b-baef-44f4-9b1e-17df61c4202f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:18.522710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 170/335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:18.528967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:18.529416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:18.529505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:18.553379 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:18.554622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:18.568207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3832-4b9c-4654-9802-80c4ecb54e89 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:18.568829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3832-4b9c-4654-9802-80c4ecb54e89 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:18.569333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3832-4b9c-4654-9802-80c4ecb54e89 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:18.571259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 171/336] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:18.576169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:18.576726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:18.577216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:18.614718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:18.616303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:18.655332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 166/337] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:18.682118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:18.763253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:18.790535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33b93-0a9d-4671-9172-46dfa49cdaa5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:18.803635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:18.834367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:18.835187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:18.835472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:18.835745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:18.851105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:18.858771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:18.860414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 167/339] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:18.866307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:18.935201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e39d4-1a30-4d97-aa94-49e5f54255fe None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:18.973415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:18.974285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:18.974566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:18.974840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:18.991875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:18.995361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc81387-6f58-40a6-a649-c138890b5ddf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:19.004048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:19.005623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 173/340] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:19.011224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:19.042387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:19.042996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.043297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.043562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.044324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:19.044882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:19.047200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:19.075841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 168/341] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:19.080089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:19.232948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879961-61be-447a-a9c8-099f1b48f6be None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:19.241322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e2233-1a70-41ea-95c8-7adfa1b9b1f7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:19.303265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759c6b6-8454-4292-9039-1d41cec7f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:19.304279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759c6b6-8454-4292-9039-1d41cec7f305 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.304801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759c6b6-8454-4292-9039-1d41cec7f305 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.305301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759c6b6-8454-4292-9039-1d41cec7f305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.319775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:19.320476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.320741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.321608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.322367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:19.322669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:19.324086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268c257-fcf1-4a7e-b22c-4e4995f161ea None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:19.343978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 174/342] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:19.345136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954643-997e-46ae-899d-d38a3aa08981 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.345419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954643-997e-46ae-899d-d38a3aa08981 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.345720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954643-997e-46ae-899d-d38a3aa08981 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.347206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 175/343] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:19.353281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954643-997e-46ae-899d-d38a3aa08981 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:19.389301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759c6b6-8454-4292-9039-1d41cec7f305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:19.390824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759c6b6-8454-4292-9039-1d41cec7f305 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:19.497312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 169/344] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:19.498745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.499037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.499323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.516488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:19.517714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:19.592026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954643-997e-46ae-899d-d38a3aa08981 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:19.609683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:19.610680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:19.632292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:19.633043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.633319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.633643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.713755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:19.715950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:19.721612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4503f5-eb98-4148-aa28-79032ba26f77 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:19.759836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0a8c5-a4af-4c76-8a7e-0a413ef0777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:19.760702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0a8c5-a4af-4c76-8a7e-0a413ef0777e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.760977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0a8c5-a4af-4c76-8a7e-0a413ef0777e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.761586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0a8c5-a4af-4c76-8a7e-0a413ef0777e None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.762449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0a8c5-a4af-4c76-8a7e-0a413ef0777e None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:19.763871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0a8c5-a4af-4c76-8a7e-0a413ef0777e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:19.765766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 171/346] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:19 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:19.766878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84be5-5fa4-4f51-9bd3-3835da572ec5 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.767201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84be5-5fa4-4f51-9bd3-3835da572ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.767475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84be5-5fa4-4f51-9bd3-3835da572ec5 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.768746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 172/347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:19.769429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84be5-5fa4-4f51-9bd3-3835da572ec5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:19.846066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 176/348] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 13:54:19.846861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:19.901489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84be5-5fa4-4f51-9bd3-3835da572ec5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:19.953672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd5e0e-8bfe-4185-bda7-8350bb2eff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:19.954832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd5e0e-8bfe-4185-bda7-8350bb2eff3b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.956279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd5e0e-8bfe-4185-bda7-8350bb2eff3b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.956787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd5e0e-8bfe-4185-bda7-8350bb2eff3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.970012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd5e0e-8bfe-4185-bda7-8350bb2eff3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:19.978323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7cdd5e0e-8bfe-4185-bda7-8350bb2eff3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 13:54:19.980075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 173/349] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:19.981709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:19.982246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:19.982752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:19.989059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa92f-a48d-4b29-88ef-962bd745985c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.009986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:20.012026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:20.030345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.031257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.031534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.031806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.039182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.041225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.042937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 177/350] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:19 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.043837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.107377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 174/351] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:20.108068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.158165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb048c-daa1-4118-b10a-8ee5693f9edb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.197212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.198130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.198411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.198685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.199897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.201327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.203141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 178/352] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.203956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.233413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c5465-60d0-415b-9488-3b4fc42d85ed None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.274648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.275329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.275612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.275890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.276644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:20.276951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.278380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.288548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 175/353] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.289490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.334801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093769f7-d902-4327-ad36-7c5877529b12 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.387324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.387324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.387595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.387822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.388632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=9729a3955af24edfbdeb99349fd99513) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:20.388944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.390985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.398911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 179/354] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.399822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.408938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f496d4-3e48-4c5c-8021-b9c5996c05c5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.456335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f646323-30dd-4fbc-81b0-dfa0c4cc456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.457157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646323-30dd-4fbc-81b0-dfa0c4cc456c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.457437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646323-30dd-4fbc-81b0-dfa0c4cc456c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.458081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646323-30dd-4fbc-81b0-dfa0c4cc456c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.472814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f646323-30dd-4fbc-81b0-dfa0c4cc456c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:20.482332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4f646323-30dd-4fbc-81b0-dfa0c4cc456c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:20.484448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 176/355] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:20.485842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cec160-bcb1-49d1-bdec-db09baee64d3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.486132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cec160-bcb1-49d1-bdec-db09baee64d3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.486465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cec160-bcb1-49d1-bdec-db09baee64d3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.487846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 177/356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:20.488567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cec160-bcb1-49d1-bdec-db09baee64d3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.531050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c715e6-e070-4b77-a869-c40ea42a1a45 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.581032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ec65f-b44b-4bbd-821d-9d54b2de63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.582049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec65f-b44b-4bbd-821d-9d54b2de63b4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.582333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec65f-b44b-4bbd-821d-9d54b2de63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.582669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec65f-b44b-4bbd-821d-9d54b2de63b4 None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.584090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ec65f-b44b-4bbd-821d-9d54b2de63b4 None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.585712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ec65f-b44b-4bbd-821d-9d54b2de63b4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.588265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 180/357] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.594986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6763-a6c9-4679-88df-88465a142852 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.595630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6763-a6c9-4679-88df-88465a142852 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.595630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6763-a6c9-4679-88df-88465a142852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.616024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-230d6763-a6c9-4679-88df-88465a142852 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:20.617297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-230d6763-a6c9-4679-88df-88465a142852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:20.632435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cec160-bcb1-49d1-bdec-db09baee64d3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.671048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.672212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.672681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.672958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] PATH_INFO: `/v3/users/ee6e0541ab7142a4b9fc0e1eab5f4f96` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.674187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] RBAC: Authorizing `identity:get_user(user_id=ee6e0541ab7142a4b9fc0e1eab5f4f96)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.675630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.677480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 178/358] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/users/ee6e0541ab7142a4b9fc0e1eab5f4f96 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.679189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.703974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:20.704851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6763-a6c9-4679-88df-88465a142852 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.820207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce210-02fb-4560-902f-774124c07c88 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.844788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6763-a6c9-4679-88df-88465a142852 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:20.858731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.859733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.860209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.860692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.861675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:20.862169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.863728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.875056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 179/360] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.876917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:20.890733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:20.891982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:20.892482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:20.893100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:20.894672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=9729a3955af24edfbdeb99349fd99513) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:20.895248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:20.897280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:20.904399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 182/361] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=f7fbbda498344183afd6e30baed3c90a => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:20.905423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.026509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412c62b-3771-4e7b-b269-2faf4c8dc0d1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.058828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a677-cc97-4b47-beb6-a95ec371106b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.080839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.081523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.081842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.082140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.083246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] RBAC: Adding query filter params (role.id=64314e84f5ec4320ab82b207c603eec9, user.id=ee6e0541ab7142a4b9fc0e1eab5f4f96, scope.system=all) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:21.083568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:21.085644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e614349-9993-4103-9a72-9ae18f09b7c5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:21.107209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 180/362] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/role_assignments?user.id=ee6e0541ab7142a4b9fc0e1eab5f4f96&scope.system=all&role.id=64314e84f5ec4320ab82b207c603eec9 => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:21.115209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07294-10e1-4836-bb93-8988a2932ff6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.115565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07294-10e1-4836-bb93-8988a2932ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.115759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07294-10e1-4836-bb93-8988a2932ff6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.117513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 181/363] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:21.120148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c07294-10e1-4836-bb93-8988a2932ff6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.128029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33294b-3e1f-4862-9202-a3ecb9d5b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.129240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33294b-3e1f-4862-9202-a3ecb9d5b637 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.129787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33294b-3e1f-4862-9202-a3ecb9d5b637 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.130269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33294b-3e1f-4862-9202-a3ecb9d5b637 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.144772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33294b-3e1f-4862-9202-a3ecb9d5b637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:21.154155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8d33294b-3e1f-4862-9202-a3ecb9d5b637 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:21.155993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:21.158107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.158587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.159050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.181405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:21.182914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:21.260083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 184/365] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:21.261273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.284870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c07294-10e1-4836-bb93-8988a2932ff6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.334878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.335932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.336439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.336979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.393632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8f366-fa1e-46dc-a0fd-12a275ecb24f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.425720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:21.427544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:21.440890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.441842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.441842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.442096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.444317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:21.444317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:21.444487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:21.466240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 185/366] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:21.467091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.553278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 182/367] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:21.554465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.571998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d246-a373-4c87-8576-5dd7ce16f9b8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.607805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.608604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.612514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.612514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.620662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:21.627591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:54:21.629115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 186/368] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:21.629920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.658120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d818-2326-494d-bd74-d9db46949beb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.692265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.692925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.693208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.693482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.734169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3f6b-a8a1-44aa-ba89-7bacfaf7d494 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.763911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:21.765393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:21.769956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.770837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.771159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.771430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.772715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:21.774348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:21.776468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 187/369] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:21.777335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.870144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 183/370] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:21.870928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.881013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90ad95-c926-44fd-8a26-8cb80988073c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:21.914492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:21.915699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:21.915975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:21.916249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:21.916994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:21.917297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:21.918680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:21.927000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 188/371] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:21.932696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:21.974868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aeca5-272c-41ce-ba1e-a22cf6a0050d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.009839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.010711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.011001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.011260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.012445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.013930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.015722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 184/372] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:22.016315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.032183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346714e-2b25-4789-a8f9-49c0e250bf2e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.067227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.068094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.068374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.068645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.069875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.071412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.073252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 189/373] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:21 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:22.074088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.126308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9df4-5334-4b88-8826-e191226ecf8b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.160971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.161651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.161935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.162214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.174412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30eb9-8ff6-49ab-82f3-a7dccae314e5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.206879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.207531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.207807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.208074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.208904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:22.209211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.210666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.216736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 190/374] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:22.217528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.232403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.233926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.322809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ea95-4cdb-4d34-bdd7-e4b4602dbb7f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.357246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.358129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.358402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.358673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.359982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.361429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.363424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 191/375] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:22.368611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 185/376] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:22.369472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.377110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.497302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481750-4b1e-4fae-8372-4effc4440f31 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.534112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.534986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.535262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.535534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] PATH_INFO: `/v3/projects/d3a0706a2a19418486859792dfa920d5` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.536777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] RBAC: Authorizing `identity:get_project(project_id=d3a0706a2a19418486859792dfa920d5)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.538306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.540916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 186/377] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/projects/d3a0706a2a19418486859792dfa920d5 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:22.546426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.573675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fff16-ff06-49d1-8a96-3dd25ec21aca None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.619989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.620635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.620921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.621196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.622066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:22.622535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.624589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.634681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 192/378] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=f7fbbda498344183afd6e30baed3c90a => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:22.670475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5dec-892b-474f-9695-9f29df607644 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.711091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40a941-7951-4f2d-83b1-727fd5e63ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.712357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a941-7951-4f2d-83b1-727fd5e63ede None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.712834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a941-7951-4f2d-83b1-727fd5e63ede None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.713396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a941-7951-4f2d-83b1-727fd5e63ede None admin] PATH_INFO: `/v3/groups/6d4ea428256442dab9f7ce8a4216b829` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.726372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a941-7951-4f2d-83b1-727fd5e63ede None admin] RBAC: Authorizing `identity:get_group(group_id=6d4ea428256442dab9f7ce8a4216b829)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.728884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a941-7951-4f2d-83b1-727fd5e63ede None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.731303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 187/379] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/groups/6d4ea428256442dab9f7ce8a4216b829 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:22.737810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:22.880798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58400-13a1-48ca-a9c8-391a9bfa4166 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:22.920499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:22.921083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:22.921368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:22.921698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:22.922531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] RBAC: Adding query filter params (group.id=6d4ea428256442dab9f7ce8a4216b829, role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=d3a0706a2a19418486859792dfa920d5) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:22.922844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:22.924286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eebd9a-4657-4e68-8b07-f64e49427790 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:22.930209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 193/380] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:22 2022] GET /identity/v3/role_assignments?group.id=6d4ea428256442dab9f7ce8a4216b829&scope.project.id=d3a0706a2a19418486859792dfa920d5&role.id=14e44e8972ac470caeba21b91a163d08 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:23.308578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab49a2-8191-477c-b381-1f48ee04eb17 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:23.308914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab49a2-8191-477c-b381-1f48ee04eb17 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:23.309090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab49a2-8191-477c-b381-1f48ee04eb17 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:23.310698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 188/381] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:23.315651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:23.315947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:23.316225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:23.334621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:23.335827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:23.423885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 194/382] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:23.459615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab49a2-8191-477c-b381-1f48ee04eb17 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:23.583299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab49a2-8191-477c-b381-1f48ee04eb17 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:23.621341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:23.622164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:23.622442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:23.622715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:23.636627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:23.643792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:23.645343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 189/383] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:23.651509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:23.798331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c16445-fda7-4532-83b9-d2890b435600 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:23.854365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:23.854970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:23.855250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:23.855525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:23.856286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:23.856592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:23.858110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:23.867179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 195/384] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:23.872973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:24.012161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135c0e-985c-4b9d-bd9f-d1799db36f7b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:24.052650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553007-a21b-40ba-950c-aedc0ae14237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:24.053514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553007-a21b-40ba-950c-aedc0ae14237 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.053825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553007-a21b-40ba-950c-aedc0ae14237 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.054099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553007-a21b-40ba-950c-aedc0ae14237 None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.055956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553007-a21b-40ba-950c-aedc0ae14237 None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:24.058345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553007-a21b-40ba-950c-aedc0ae14237 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:24.060310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 190/385] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:23 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:24.066616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:24.141318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48178f-765e-42be-b7a7-1baf796487bc None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.141698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48178f-765e-42be-b7a7-1baf796487bc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.141935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48178f-765e-42be-b7a7-1baf796487bc None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.143523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 191/386] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:24.148755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.149105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.149386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.185797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:24.186999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:24.205531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0bc7-4491-44fc-bee3-2b50363b9014 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:24.242731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:24.244115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.244392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.244659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.245947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:24.247389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:24.249404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 196/387] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:24 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:24.255180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:24.326347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:24.350610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:24.363137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b87f52-3a57-42f6-9ac3-5ab8277c4993 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:24.408103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:24.408923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.409201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.409470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513/groups/249e27e152d2446ab5a4179090271b1c/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.411649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] RBAC: Authorizing `identity:create_grant(project_id=9729a3955af24edfbdeb99349fd99513, group_id=249e27e152d2446ab5a4179090271b1c, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:24.413262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:24.432107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 197/389] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Apr 28 13:54:24 2022] PUT /identity/v3/projects/9729a3955af24edfbdeb99349fd99513/groups/249e27e152d2446ab5a4179090271b1c/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:24.541501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c1f-6700-4a1d-ab55-514582a7f327 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:24.581801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:24.582634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.582916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.583192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.598328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:24.606546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:24.608224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 193/390] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:24.613957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:24.767549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e894a-c513-49ad-9d43-d21744789538 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:24.816216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:24.817276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.817816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.818294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.819402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:24.819911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:24.821541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:24.833078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 198/391] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:24.839852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:24.959373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f91e1-9d6c-4efd-81e0-28e6df78eb52 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:24.996166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:24.997035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:24.997313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:24.997635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:24.998831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:25.000288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:25.002295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 194/392] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:24 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:25.015133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:25.171342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad55c9-c974-4903-a21f-62cca5f1f424 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:25.213576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea4ebd-06ca-4e1e-8428-388e448b2a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:25.214431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4ebd-06ca-4e1e-8428-388e448b2a16 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.214713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4ebd-06ca-4e1e-8428-388e448b2a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.214983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4ebd-06ca-4e1e-8428-388e448b2a16 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.216183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea4ebd-06ca-4e1e-8428-388e448b2a16 None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:25.217672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea4ebd-06ca-4e1e-8428-388e448b2a16 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:25.219361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 199/393] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:25 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:25.225721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:25.365218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25511203-e1e6-433d-9f60-0e7a41f4f566 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:25.409954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a55714-fc56-44e6-ba77-2ef8ec2b4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:25.410850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55714-fc56-44e6-ba77-2ef8ec2b4871 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.411134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55714-fc56-44e6-ba77-2ef8ec2b4871 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.411410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55714-fc56-44e6-ba77-2ef8ec2b4871 None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513/groups/249e27e152d2446ab5a4179090271b1c/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.413651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a55714-fc56-44e6-ba77-2ef8ec2b4871 None admin] RBAC: Authorizing `identity:create_grant(project_id=9729a3955af24edfbdeb99349fd99513, group_id=249e27e152d2446ab5a4179090271b1c, role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:25.415145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a55714-fc56-44e6-ba77-2ef8ec2b4871 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:25.438536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 195/394] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Apr 28 13:54:25 2022] PUT /identity/v3/projects/9729a3955af24edfbdeb99349fd99513/groups/249e27e152d2446ab5a4179090271b1c/roles/f7fbbda498344183afd6e30baed3c90a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:25.550226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89eab9-e3d9-42df-ac5c-0ed08bc88670 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.550579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89eab9-e3d9-42df-ac5c-0ed08bc88670 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.550797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89eab9-e3d9-42df-ac5c-0ed08bc88670 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.552364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 200/395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:25.558703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4226-e284-493c-b133-49fe0d27d8f3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.558992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4226-e284-493c-b133-49fe0d27d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.559276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4226-e284-493c-b133-49fe0d27d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.578909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-13cd4226-e284-493c-b133-49fe0d27d8f3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:25.580139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-13cd4226-e284-493c-b133-49fe0d27d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:25.656715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 196/396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:25.683839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89eab9-e3d9-42df-ac5c-0ed08bc88670 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:25.694850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432de29-d1de-4f85-9fbf-11b01ab9f232 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.695152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432de29-d1de-4f85-9fbf-11b01ab9f232 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.695414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432de29-d1de-4f85-9fbf-11b01ab9f232 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.696868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 197/397] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:25.702545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.702828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.703107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.724274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:25.725474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:25.795803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89eab9-e3d9-42df-ac5c-0ed08bc88670 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:25.808709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 198/398] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:25.830658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:25.831512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.831790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.832112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.834194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:25.843540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:25.850677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:25.852879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 201/399] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:25.858569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:25.945730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e718336-0ca6-448b-8676-a1f110e44ba4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:25.960333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0cd1d-4731-4aac-91e5-6f0752dccc8a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:25.981871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:25.983530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.984029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.984534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.995788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:25.996484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:25.996767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:25.997043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:25.997691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:25.997874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:25.998152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:25.999565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.005586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:54:26.007424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 199/400] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:26.012467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 202/401] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:26.013634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.015410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.118779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94d90-0b3e-49fd-a142-ae5c539a9122 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.128104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a399b-92e3-4b87-8c87-13d2fbd1eb1a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.152699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c42fe9-d648-4e7c-a3eb-46196a246d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.153584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c42fe9-d648-4e7c-a3eb-46196a246d05 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.153871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c42fe9-d648-4e7c-a3eb-46196a246d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.154146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c42fe9-d648-4e7c-a3eb-46196a246d05 None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.155319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c42fe9-d648-4e7c-a3eb-46196a246d05 None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.156752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c42fe9-d648-4e7c-a3eb-46196a246d05 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.158926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 203/402] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:26.159927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daa9fa-4adf-45ff-97be-4af456a50fcb None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.160145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daa9fa-4adf-45ff-97be-4af456a50fcb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.160421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daa9fa-4adf-45ff-97be-4af456a50fcb None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.164313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.165838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.165949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 204/403] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:26.166435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.166915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.167864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:26.168359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daa9fa-4adf-45ff-97be-4af456a50fcb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.168558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.170429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114114-b87e-49a2-86d7-daa1724d4c8c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.179609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 200/404] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:26.181185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678015-8439-4867-859b-24a20f07ad0c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.185811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678015-8439-4867-859b-24a20f07ad0c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.186315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678015-8439-4867-859b-24a20f07ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.203111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-be678015-8439-4867-859b-24a20f07ad0c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:26.204580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-be678015-8439-4867-859b-24a20f07ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:26.272045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daa9fa-4adf-45ff-97be-4af456a50fcb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.277524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 201/405] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:26.278643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be678015-8439-4867-859b-24a20f07ad0c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.306461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.307323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.307607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.307882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.309058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.310519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.312508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 205/406] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:26.317813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.383378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be678015-8439-4867-859b-24a20f07ad0c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.416675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df81803-e164-493b-99a3-6d71458b30d5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.420477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.421624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.422111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.422764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] PATH_INFO: `/v3/groups/6d4ea428256442dab9f7ce8a4216b829` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.424219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] RBAC: Authorizing `identity:get_group(group_id=6d4ea428256442dab9f7ce8a4216b829)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.425945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.428162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 202/407] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/groups/6d4ea428256442dab9f7ce8a4216b829 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:26.429115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.451222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.451955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.452238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.452513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.462995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:26.470373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:26.472331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 206/408] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:26.472789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.538761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f8e3-3758-440a-9519-e99adfcdef22 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.572732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c936-9389-466a-812c-e37872a58bc8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.574954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.576089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.576599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.577078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/groups/249e27e152d2446ab5a4179090271b1c/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.579550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] RBAC: Authorizing `identity:create_grant(project_id=57aedd2cc5f34328b201ec2cb1b3b18f, group_id=249e27e152d2446ab5a4179090271b1c, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.581252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.597173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 203/409] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Apr 28 13:54:26 2022] PUT /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/groups/249e27e152d2446ab5a4179090271b1c/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:26.598415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.623015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.623881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.624159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.624432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] PATH_INFO: `/v3/projects/d3a0706a2a19418486859792dfa920d5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.627072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] RBAC: Authorizing `identity:get_project(project_id=d3a0706a2a19418486859792dfa920d5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.628526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.630585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 207/410] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/projects/d3a0706a2a19418486859792dfa920d5 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:26.637430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.718178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5f4eb-47ba-4861-b360-36c1f231275c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.756480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.757595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.758125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.759190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.760209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:26.760789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.762548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.772396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 204/411] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:26.778927 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:26.874800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4f96f-aab8-415e-ba0d-3d567b6e4ebc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.900888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de83c6-ba3a-4a39-b373-0c6543b34084 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:26.910357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.911703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.912189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.912686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] PATH_INFO: `/v3/projects/d3a0706a2a19418486859792dfa920d5/groups/6d4ea428256442dab9f7ce8a4216b829/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.914924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3a0706a2a19418486859792dfa920d5, group_id=6d4ea428256442dab9f7ce8a4216b829, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.916583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.936621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 208/412] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Apr 28 13:54:26 2022] PUT /identity/v3/projects/d3a0706a2a19418486859792dfa920d5/groups/6d4ea428256442dab9f7ce8a4216b829/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 13:54:26.939740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:26.940525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:26.940804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:26.941132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:26.942536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:26.944124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:26.946946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 205/413] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:26.954195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:27.088970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0a889-07c8-42cf-8b29-8d2e8263ace0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:27.130803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cd704-0eea-4763-b95d-5b1a080471fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:27.132080 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cd704-0eea-4763-b95d-5b1a080471fe None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:27.132564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cd704-0eea-4763-b95d-5b1a080471fe None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:27.133020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cd704-0eea-4763-b95d-5b1a080471fe None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:27.134687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cd704-0eea-4763-b95d-5b1a080471fe None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:27.136430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cd704-0eea-4763-b95d-5b1a080471fe None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:27.138881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 209/414] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:26 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:27.144893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:27.296790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999afb-bc0f-4462-87c4-a005e9a0494b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:27.329232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe9f6d-d112-4306-b905-dd5aae2e4639 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:27.329534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe9f6d-d112-4306-b905-dd5aae2e4639 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:27.329830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe9f6d-d112-4306-b905-dd5aae2e4639 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:27.331177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 210/415] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:27.337547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:27.337876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:27.338154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:27.339468 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:27.340301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:27.340587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:27.340863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/groups/249e27e152d2446ab5a4179090271b1c/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:27.343130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=57aedd2cc5f34328b201ec2cb1b3b18f, group_id=249e27e152d2446ab5a4179090271b1c, role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:27.344569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:27.360056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:27.363340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:27.373800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 206/416] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Apr 28 13:54:27 2022] PUT /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f/groups/249e27e152d2446ab5a4179090271b1c/roles/f7fbbda498344183afd6e30baed3c90a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:27.441206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 211/417] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:27.465190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:27.599420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92500-e185-4135-b020-70f9a6715a5e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:27.641103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:27.641942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:27.642226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:27.642505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:27.653082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:27.660358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:27.662129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 207/418] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:27.673161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:27.795696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b670-cbe1-4778-908b-914aeea43dbe None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:27.831936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:27.832841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:27.833258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:27.833718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:27.834596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:27.835038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:27.836581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a155c-4d4f-4410-9d14-196245c598b3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:27.845492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 212/419] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:27.851587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:27.972179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f8f7-71d0-49d8-a784-dd884ac4a288 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:28.021735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:28.022423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.022711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.022993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.128373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:28.129785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:28.209256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3277c-c0dd-499f-b980-96a86d081584 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.209817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3277c-c0dd-499f-b980-96a86d081584 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.209895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3277c-c0dd-499f-b980-96a86d081584 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.212024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 213/420] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:28.216955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.217241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.217524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.234308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:28.235495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:28.262146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 208/421] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:28.269541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:28.349968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 214/422] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:28.390986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:28.426716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336d74-ea31-4db7-b26b-d60485c176ec None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:28.489368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:28.490316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.490654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.490937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.493648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:28.495187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:28.498836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 209/423] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:28 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:28.504341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:28.555660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08cf48-e7dd-4f1c-862f-12bb43a62901 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:28.617251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:28.618705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.618990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.619305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.647371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:28.654452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7c381-f2d0-4c6c-b828-7ec73eed124e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:28.663112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:28.665060 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 215/424] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:28.670653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:28.694300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:28.695546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.696052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.697860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.699952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:28.701608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:28.710393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 210/425] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:28 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:28.715512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:28.851383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6ee30-2b26-4fc9-8b0e-38402a2755bb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:28.885184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ad83f-036f-41a6-93b9-ff8e4a506103 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:28.889867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:28.891375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.891659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.891936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.892776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=9729a3955af24edfbdeb99349fd99513) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:28.893088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:28.894575 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:28.902049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 211/426] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:28 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:28.944973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:28.945724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:28.946011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:28.946288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:28.947057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:28.947365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:28.948758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:28.961818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 216/427] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:28.963693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.133243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a837f-9a98-4e74-b027-9e3e9593c69f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:29.172528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242d2df-9936-493e-a02b-ef43d76598c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:29.173126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d2df-9936-493e-a02b-ef43d76598c9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.173412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d2df-9936-493e-a02b-ef43d76598c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.173716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d2df-9936-493e-a02b-ef43d76598c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.262091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242d2df-9936-493e-a02b-ef43d76598c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:29.263559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242d2df-9936-493e-a02b-ef43d76598c9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:29.364117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 212/428] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:29.374902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.391112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9ce0-c661-42ac-b1ec-3a95726767dd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.391419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9ce0-c661-42ac-b1ec-3a95726767dd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.391686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9ce0-c661-42ac-b1ec-3a95726767dd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.393221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 213/429] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:29.398426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.398768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.399554 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.417112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:29.418327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:29.490877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 214/430] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:29.516073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.526989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1604cb-6f5d-49e7-a5ec-52a43c2c09ba None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:29.575190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:29.576718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.577174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.577662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] PATH_INFO: `/v3/projects/9729a3955af24edfbdeb99349fd99513` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.579657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] RBAC: Authorizing `identity:get_project(project_id=9729a3955af24edfbdeb99349fd99513)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:29.581797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:29.585012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 217/431] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:29 2022] GET /identity/v3/projects/9729a3955af24edfbdeb99349fd99513 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:29.591324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.629390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b90a6-32e6-4f48-b945-c824c2ece1e2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:29.663351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:29.664157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.664440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.664715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.675501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:29.683232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 13:54:29.684464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 215/432] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:29.690097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.705127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bafb0-f521-4a98-b7e8-6eb4d5de2aba None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:29.741448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:29.743273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.743780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.744251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.745759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:29.747421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:29.749678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 218/433] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:29 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:29.755654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.800441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8379a-24ff-4bb6-90f5-94b858852233 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:29.841975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:29.842645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.843342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.843626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.844376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:29.845150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:29.847037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23450809-0486-49f3-8db7-00dadcf8a3a8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:29.861409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 216/434] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:29.861409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4384e04-7a69-4fbd-8346-7224afe9b807 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.861409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4384e04-7a69-4fbd-8346-7224afe9b807 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.861409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4384e04-7a69-4fbd-8346-7224afe9b807 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.862279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 217/435] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:29.862992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4384e04-7a69-4fbd-8346-7224afe9b807 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:29.868384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bf59-ca4f-4af0-9726-81df1e7ca574 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:29.902081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:29.902727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.903004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.903273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.904094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=9729a3955af24edfbdeb99349fd99513) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:29.904402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:29.905837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b75a91-742b-49bd-abaa-386367169122 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:29.921767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 219/436] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:29 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=9729a3955af24edfbdeb99349fd99513&role.id=f7fbbda498344183afd6e30baed3c90a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:29.921767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:29.921767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:29.921767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:29.938288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:29.939522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:29.981806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4384e04-7a69-4fbd-8346-7224afe9b807 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.019282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.019861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.020137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.020412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.022361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 220/437] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:30.053442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.121739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.123528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.181052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b7675-bf51-48ee-b445-e578c54ac304 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.221895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.223187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.223619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.224037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.236209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:30.243689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 218/438] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:30.244927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:54:30.247381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 221/439] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:30.249231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.251944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.382738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabc2d-5625-40c2-8131-d2d0a9179299 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.386657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc4cf0-f21f-4092-bf39-d3eb2e88f2c9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.426291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.426962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.427240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.427512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.428255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:30.428557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.429143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.430571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.430677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.430677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.430677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.431951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.435358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.436491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 219/440] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:30.439617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 222/441] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:30.444055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.445178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.539010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d914b4-1dd1-49f2-bd33-98ac118dd82c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.541755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000789-2e9e-4aa7-ae83-30fcb6d42033 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.571187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afc25e-c6ed-4efc-922d-b91af124c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.572035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afc25e-c6ed-4efc-922d-b91af124c7cd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.572313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afc25e-c6ed-4efc-922d-b91af124c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.572583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afc25e-c6ed-4efc-922d-b91af124c7cd None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.573549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.573827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afc25e-c6ed-4efc-922d-b91af124c7cd None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.574205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.574485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.574759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.575257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afc25e-c6ed-4efc-922d-b91af124c7cd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.576864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 220/442] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:30.578043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77cb6-a85d-4b0a-8f3d-5c1fdc9e0bf9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.578338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77cb6-a85d-4b0a-8f3d-5c1fdc9e0bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.578601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77cb6-a85d-4b0a-8f3d-5c1fdc9e0bf9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.580037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 221/443] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:30.582512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e77cb6-a85d-4b0a-8f3d-5c1fdc9e0bf9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.639378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.640737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.676058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e77cb6-a85d-4b0a-8f3d-5c1fdc9e0bf9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.708013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.708653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.708933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.709210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.710065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=ebb9c3282d21483bba8630dd78798d6b, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:30.710374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.711824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f289-77b6-4df4-8d96-5c5c2580d6c9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.717371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 222/444] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=ebb9c3282d21483bba8630dd78798d6b => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:30.718546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.718834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.719109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.732193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 223/445] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:30.736626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:30.737485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.737830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:30.809797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 223/446] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:30.833026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.843126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f21d-8244-4071-af41-53fcdcf88e19 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.879248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.880122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.880398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.880670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] PATH_INFO: `/v3/projects/d3a0706a2a19418486859792dfa920d5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.881923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] RBAC: Authorizing `identity:get_project(project_id=d3a0706a2a19418486859792dfa920d5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:30.883432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:30.885473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 224/447] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/projects/d3a0706a2a19418486859792dfa920d5 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:30.891049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:30.942808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500b503-0023-4adc-ae29-4bea34979d00 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.984368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:30.985177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:30.985465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:30.985773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:30.995999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4afad-736a-44cf-8568-0f2ae4614c6f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:30.997273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:31.004710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:31.006170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 224/448] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:31.011627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:31.037065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.037954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.038239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.038512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] PATH_INFO: `/v3/groups/6d4ea428256442dab9f7ce8a4216b829` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.040315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] RBAC: Authorizing `identity:get_group(group_id=6d4ea428256442dab9f7ce8a4216b829)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.041802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.045706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 225/449] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:30 2022] GET /identity/v3/groups/6d4ea428256442dab9f7ce8a4216b829 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:31.052356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:31.123433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f6465-38d8-4e5e-9d31-94e10f38f1ac None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:31.154981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.155576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.155678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101cbb-4928-4aa4-bf15-d5ed3109c9d0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:31.155857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.156128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.156869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:31.157175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.158572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.166688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 225/450] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:31.172401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:31.188141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.188862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.189140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.189409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.190258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] RBAC: Adding query filter params (group.id=6d4ea428256442dab9f7ce8a4216b829, role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=d3a0706a2a19418486859792dfa920d5) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:31.190565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.191972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.197509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 226/451] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:31 2022] GET /identity/v3/role_assignments?group.id=6d4ea428256442dab9f7ce8a4216b829&scope.project.id=d3a0706a2a19418486859792dfa920d5&role.id=14e44e8972ac470caeba21b91a163d08 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:31.278230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a3515-a665-4dd2-b26e-4052c2398dd9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:31.311893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.312552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.312836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.313110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.379229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.380671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.484139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 226/452] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 13:54:31.489646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:31.583436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da1f8-0e47-4341-9212-1975856fc469 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:31.614547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.615384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.615660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.615929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] PATH_INFO: `/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.617072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] RBAC: Authorizing `identity:get_project(project_id=57aedd2cc5f34328b201ec2cb1b3b18f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.619140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.620807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 227/453] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:54:31 2022] GET /identity/v3/projects/57aedd2cc5f34328b201ec2cb1b3b18f => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:31.626410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:31.717201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f618-824b-47ef-9224-8f5f6a1c4cf4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:31.749820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ffaf4-a873-4d7d-bc57-d9b74e883c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.750607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ffaf4-a873-4d7d-bc57-d9b74e883c97 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.750890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ffaf4-a873-4d7d-bc57-d9b74e883c97 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.751166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ffaf4-a873-4d7d-bc57-d9b74e883c97 None admin] PATH_INFO: `/v3/groups/249e27e152d2446ab5a4179090271b1c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.752317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ffaf4-a873-4d7d-bc57-d9b74e883c97 None admin] RBAC: Authorizing `identity:get_group(group_id=249e27e152d2446ab5a4179090271b1c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.753766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ffaf4-a873-4d7d-bc57-d9b74e883c97 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.755335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 227/454] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Apr 28 13:54:31 2022] GET /identity/v3/groups/249e27e152d2446ab5a4179090271b1c => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:31.760980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:31.851195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e64017-f261-48b2-a6cd-2f6c26763842 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:31.883245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:31.883874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:31.884150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:31.884421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:31.885344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] RBAC: Adding query filter params (group.id=249e27e152d2446ab5a4179090271b1c, role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:31.885677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:31.887095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37320436-c61c-4d45-8e3c-bfc0eae62373 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:31.892634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 228/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Apr 28 13:54:31 2022] GET /identity/v3/role_assignments?group.id=249e27e152d2446ab5a4179090271b1c&scope.project.id=57aedd2cc5f34328b201ec2cb1b3b18f&role.id=f7fbbda498344183afd6e30baed3c90a => generated 611 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:34.913148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6088-d9e4-4ecc-aeac-600276aa9d6b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:34.913689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6088-d9e4-4ecc-aeac-600276aa9d6b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:34.913765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6088-d9e4-4ecc-aeac-600276aa9d6b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:34.915341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 228/456] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:34.921176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf609e4-7237-4f66-a1fe-23a21e29bc58 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:34.922039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf609e4-7237-4f66-a1fe-23a21e29bc58 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:34.922517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf609e4-7237-4f66-a1fe-23a21e29bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:34.947071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-acf609e4-7237-4f66-a1fe-23a21e29bc58 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:34.948641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-acf609e4-7237-4f66-a1fe-23a21e29bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:35.033628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 229/457] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:35.069630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e6088-d9e4-4ecc-aeac-600276aa9d6b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.096869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f4c7-6604-40e3-919f-38cbf05b85bc None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.098024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f4c7-6604-40e3-919f-38cbf05b85bc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.098494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f4c7-6604-40e3-919f-38cbf05b85bc None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.100049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 230/458] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:35.113123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083be85-ab62-424b-a622-367c2060929e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.113719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083be85-ab62-424b-a622-367c2060929e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.114192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083be85-ab62-424b-a622-367c2060929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.147313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2083be85-ab62-424b-a622-367c2060929e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:35.148868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2083be85-ab62-424b-a622-367c2060929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:35.196887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e6088-d9e4-4ecc-aeac-600276aa9d6b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.219248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 231/459] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:35.220856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97029d-1571-4938-aeab-10cebfee8222 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.221335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97029d-1571-4938-aeab-10cebfee8222 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.221838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97029d-1571-4938-aeab-10cebfee8222 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.223373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 232/460] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:35.230250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.230972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.232604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.254865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.255681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.255964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.256237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.257676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:35.259643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:35.268826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.270991 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.293484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:35.296252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 229/461] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:35.297120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.333919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 233/462] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:35.335637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.401479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbd018-e7d4-444d-a024-56a03dd67c9a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.434830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.435613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.435896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.436162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.445908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.447409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.453113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7d9db-1b72-4ef7-b4a7-c132c875c68f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.463577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:35.464774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 230/463] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:35.465538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.493685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.494751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.495198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.495628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.496361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:35.496670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.498079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465dec2-75f4-450f-aa22-58036409b53e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.521640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 234/464] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:35.521640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2dbc-a66c-40a2-a1de-9b1cab937738 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.521640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2dbc-a66c-40a2-a1de-9b1cab937738 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.521640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2dbc-a66c-40a2-a1de-9b1cab937738 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.522002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 235/465] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:35.522692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2dbc-a66c-40a2-a1de-9b1cab937738 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.564355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09997b64-64b9-415a-aaeb-f916d8de4146 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.597316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.598151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.598421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.598682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.609328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.611254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.629414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:35.633768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2dbc-a66c-40a2-a1de-9b1cab937738 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.633932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 231/466] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:35.634856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.667984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.668635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.668912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.669182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.670174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:35.670475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.671838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741260e-a0e4-4ef9-988b-800ded71a934 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.683960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 236/467] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:35.685950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344773b0-c105-4113-bd16-587d117528b2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.686438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344773b0-c105-4113-bd16-587d117528b2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.686924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344773b0-c105-4113-bd16-587d117528b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.705793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-344773b0-c105-4113-bd16-587d117528b2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:35.706883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-344773b0-c105-4113-bd16-587d117528b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:35.736265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f162-d273-4e0f-bad0-b914e7e597c1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.769663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.770689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.770967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.771240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.781755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 237/468] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:35.781911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.782006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344773b0-c105-4113-bd16-587d117528b2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.782077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.799346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 232/469] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:35 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:54:35.800064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.910095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344773b0-c105-4113-bd16-587d117528b2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.919735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca686b2-6f68-410f-aa14-54e2220e238e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:35.949094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.949944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.950336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.950739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.951586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:35.952034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.953598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.958217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:35.959088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:35.959515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:35.959942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:35.960854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:35.963071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:35.972496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 238/470] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:35.973766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:35.987547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 233/471] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:35 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:54:35.988742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:36.084683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184946b-e935-4862-bf12-02e1bfb5a682 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.104969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6d47-e979-44e1-87b2-2662c89b5cd4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.138350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.139024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.139305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.139580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.152252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93220181-57dc-48d6-9a93-7b814cc12896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.153451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93220181-57dc-48d6-9a93-7b814cc12896 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.153789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93220181-57dc-48d6-9a93-7b814cc12896 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.154067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93220181-57dc-48d6-9a93-7b814cc12896 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.154931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93220181-57dc-48d6-9a93-7b814cc12896 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:36.155144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:36.156411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93220181-57dc-48d6-9a93-7b814cc12896 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:36.156693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:36.176892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-171ec46c-7566-45f6-b008-c61f7ba09ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:36.178417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 239/472] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:36.180492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ee03-958b-41c5-b723-5e6ad0828431 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.180778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ee03-958b-41c5-b723-5e6ad0828431 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.181593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ee03-958b-41c5-b723-5e6ad0828431 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.181724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 234/473] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:35 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:54:36.183274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 240/474] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:36.189355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.189702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.189987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.192569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699ee03-958b-41c5-b723-5e6ad0828431 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:36.209521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:36.210973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:36.302558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 235/475] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:36.318326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699ee03-958b-41c5-b723-5e6ad0828431 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.326205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:36.360531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.361595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.362087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.362516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.363516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:36.363828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:36.365298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:36.380001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 241/476] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:36.385739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:36.448925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26248adb-6b90-4020-80eb-80f4c1c2cef9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.498271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.499418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.500200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.500675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.501934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:36.504376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:36.508746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc094-7cc3-48a7-b021-bedf0bc56048 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.513772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.sql.core [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 28 13:54:36.513772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 28 13:54:36.513772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [parameters: {'id': '1b9d57bb9e5b4cee88c9542443ad2c73', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 28 13:54:36.513772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79785) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 28 13:54:36.533548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 28 13:54:36.536352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Apr 28 13:54:36 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:36.543094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:36.550487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.551246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.551598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.551944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.552723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:36.554261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:36.581592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:36 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:54:36.677109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc45d-1cd4-4988-8f74-8be5bb767c31 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.715076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5768ae-202e-4e4d-bfee-dbc16e646acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.716261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5768ae-202e-4e4d-bfee-dbc16e646acb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.716762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5768ae-202e-4e4d-bfee-dbc16e646acb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.717244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5768ae-202e-4e4d-bfee-dbc16e646acb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.731491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5768ae-202e-4e4d-bfee-dbc16e646acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:36.739639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fd5768ae-202e-4e4d-bfee-dbc16e646acb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 13:54:36.743251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:54:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:36.747618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:36.871787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73fad-59c9-48e6-8f15-e4b90314e798 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:36.915920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:36.916749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:36.917125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:36.917490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:36.918393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:36.918790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:36.920513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c687ed-8dc0-436b-a29f-f72cc83dc5d7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:36.930534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:38.595114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9304f5-b3b4-4e7c-a8c2-f79c6e6c862f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:38.595633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9304f5-b3b4-4e7c-a8c2-f79c6e6c862f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:38.595709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9304f5-b3b4-4e7c-a8c2-f79c6e6c862f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:38.597299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:38.603316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfade-eb12-450d-abfc-5ea8f43a9340 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:38.603760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfade-eb12-450d-abfc-5ea8f43a9340 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:38.603939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfade-eb12-450d-abfc-5ea8f43a9340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:38.630791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9cfcfade-eb12-450d-abfc-5ea8f43a9340 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:38.632007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9cfcfade-eb12-450d-abfc-5ea8f43a9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:38.724161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:38.771902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9304f5-b3b4-4e7c-a8c2-f79c6e6c862f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:38.842587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40943-a43b-4f54-9d61-49abc68b14a4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:38.842902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40943-a43b-4f54-9d61-49abc68b14a4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:38.843157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40943-a43b-4f54-9d61-49abc68b14a4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:38.844989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 245/483] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:38.850823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:38.851052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:38.851328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:38.880514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:38.881749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:38.910558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9304f5-b3b4-4e7c-a8c2-f79c6e6c862f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:38.969781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:38.970920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:38.971402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:38.971870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:38.984436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:38.993980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:38.996046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 239/484] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:39.000246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 246/485] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:39.001595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.042412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.161733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b11935-a946-4af1-a040-d9fa544edf1d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.199405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee6a36-1da7-4806-b30c-a91f0829d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.200535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6a36-1da7-4806-b30c-a91f0829d391 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.201073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6a36-1da7-4806-b30c-a91f0829d391 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.201356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6a36-1da7-4806-b30c-a91f0829d391 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.203271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3482-b4c9-4425-b591-1968cfaa7a69 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.213127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee6a36-1da7-4806-b30c-a91f0829d391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:39.222395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-80ee6a36-1da7-4806-b30c-a91f0829d391 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:39.229543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 247/486] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:39.231254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc640-01d3-4017-a308-2d96a79b4e9a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.231544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc640-01d3-4017-a308-2d96a79b4e9a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.231819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc640-01d3-4017-a308-2d96a79b4e9a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.233307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 248/487] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:39.234618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc640-01d3-4017-a308-2d96a79b4e9a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.253835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.255222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.255958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.256435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.257944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:39.258470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.260047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9b00-a0da-4884-bc77-b11b8c202f97 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.275677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 240/488] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:39.275677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.275677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.275677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.296953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:39.298183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:39.362763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 241/489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:39.363842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.370024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc640-01d3-4017-a308-2d96a79b4e9a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.424391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.425151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.425902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.426387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.427590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:39.428007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.430118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.439293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 249/490] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:39.440106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.498040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aa61f-8c61-4882-bd46-c293524be329 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.533501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.534682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.535146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.535630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.547329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe06050-dc7b-4788-a7e1-8d34d4f4a55d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.548741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.550510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.569226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:39.575431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 242/491] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:39.576692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.584484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.585283 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.585580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.586460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.597328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:39.604972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:39.610826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 250/492] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:39.610826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.688585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812a25-770f-4e8b-b3d4-45e9e3ce70c1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.710412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d37c41-1ec6-4a2d-be7f-06d59022f5cc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.724402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.725455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.725941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.727309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.738175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.739647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.745978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.746634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.746915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.747190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.748051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:39.748227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.749602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfeab6-ae09-4135-ba6f-c5f077645032 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.756401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:39.758234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 243/493] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:39.758234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.770021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 251/494] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:39.770021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f3bf-2403-4a45-98f0-6fb061d9920e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.770021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f3bf-2403-4a45-98f0-6fb061d9920e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.770021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f3bf-2403-4a45-98f0-6fb061d9920e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.770966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 252/495] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:39.771677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67f3bf-2403-4a45-98f0-6fb061d9920e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.864608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad9f1-1c8a-44e2-834d-499dceb655d4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.874321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67f3bf-2403-4a45-98f0-6fb061d9920e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:39.896809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.897471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.897777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.898051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.899397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:39.899702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.901082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.906050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:39.906690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.906968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.907255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.907939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:39.908238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:39.908598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 244/496] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:39.909363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:39.909646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b2f69-f97b-40a2-a705-bbd411c04daa None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:39.920750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 253/497] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:39.922059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e026-fd7a-4502-b05a-71707a874b60 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:39.922342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e026-fd7a-4502-b05a-71707a874b60 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:39.922612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e026-fd7a-4502-b05a-71707a874b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:39.937851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5f00e026-fd7a-4502-b05a-71707a874b60 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:39.939079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5f00e026-fd7a-4502-b05a-71707a874b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:40.000066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 254/498] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:40.001355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932de16-ea34-4e83-9c7b-014745068f98 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.001688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932de16-ea34-4e83-9c7b-014745068f98 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.001969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932de16-ea34-4e83-9c7b-014745068f98 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.003224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 255/499] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:40.003914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932de16-ea34-4e83-9c7b-014745068f98 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.009151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7cc75-fbe0-41c2-ae77-7797faf6e157 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.040867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.041681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.041967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.042241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.049682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.051139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.063840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:54:40.065007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 245/500] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:54:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:40.065788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.103128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932de16-ea34-4e83-9c7b-014745068f98 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.135716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.136502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.136782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.137055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.146509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.147958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.158757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68589c-cce6-492d-a5a7-4be55c8e3f4b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.164798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7f11f4ca-cc14-4c69-8180-a5d55ba3668f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:40.165994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 256/501] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:40.167156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.167441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.167716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.183918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:40.185103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:40.190888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.191623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.191909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.192189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.199979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.201424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.214225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 28 13:54:40.215383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 246/502] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:40.216135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.250943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 257/503] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:40.251777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.308712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7314b0-724f-43c4-8a0c-e9082385fad3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.339883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.340665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.340943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.341215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.342907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8a2c-dd04-47d1-b188-c63c4c2f78b5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.350694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:40.357595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:40.358777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 247/504] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:40.359525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.374415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.375075 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.375351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.375619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.376446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:40.376746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.378190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.412558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 258/505] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:40.413344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.454551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fe1b2-e1a3-4f36-aac7-a26430534f65 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.485270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.485951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.486237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.486509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.487219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:40.487521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.488884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.500452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 248/506] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:40.501219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.505611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4850a46-d4f5-4f26-ad56-80e47261b38a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.538647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.539806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.540089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.540363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.541196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:40.541503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.542971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.559791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 259/507] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:40.560568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.595781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d75de-64e5-40f5-b95a-6ef8379eb6fc None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.629160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.629975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.630265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.630543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.640087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.641537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.652655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c7bd0-4a5c-4896-b9aa-6b493c0d2acd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.657736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:40.658928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 249/508] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:40.659713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.685474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.686164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.686445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.686721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.687458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:40.687762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.689127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.696511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 260/509] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:40.697279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.752478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aefe04-d398-40ae-8d26-693090af4a46 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.783563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.784204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.784493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.784770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.788736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ceb97a-709f-4565-8dfd-c2ce7c3edbc3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.820687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.821469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.821774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.822048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:40.829220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.830698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.843520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 13:54:40.844679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 261/510] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:40.845443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.850571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:40.852551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:40.937675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a172c0-3092-4fc1-82c6-e42e51c2325d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:40.944464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 250/511] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:40.945376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:40.968588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:40.969217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:40.969494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:40.969792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.031177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.032536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.038243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0c7aa-caa7-4216-8302-5bd3714336ec None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.069844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.070521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.070802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.071073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.071780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:41.072084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.073428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.083981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 251/512] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:41.084750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.133544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 262/513] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:41.134408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.183229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680156-bb36-4e56-a61c-8247745832ce None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.214574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.215350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.215627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.215897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.224704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478217-0e3c-4fde-8814-441098d0166f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.225796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.227800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.243190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:41.244352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 252/514] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:41.245104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.256388 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.257049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.257330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.258160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.258990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:41.259298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.260721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.277667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 263/515] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:41.278427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.340418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8eaa-5503-4d6f-af8e-d5e7ae4d9040 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.369326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfb97d-22d9-4127-a9e4-38f1c2a3ac51 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.371148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.372426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.372730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.373009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.387108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.388559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.402132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.402784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.403065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.403338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.404029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.404755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:41.405432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.410500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 253/516] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:41.410500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.427911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 264/517] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:41 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:54:41.428781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.521046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062470-26cd-449b-aaab-7169c05b6e00 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.534057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35016cd-d3f3-4e9b-96b7-ec906ae826e6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.556801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.557644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.557928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.558202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.567826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.568505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.568785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.569056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.569471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.569812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:41.570663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.571508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.572026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.589136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 265/518] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:41.589136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.589425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:41.590757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 254/519] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:41.595557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.694813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc1682-ba8d-4a29-8c64-e5a1f7402b8a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.696584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeef3fe-09dc-4d86-a73c-489df9dcc71e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.727397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.727724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.728048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.728331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.728457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.728611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.728706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.728905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.729647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:41.729954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.731322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.743254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 255/520] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:41.744073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.798019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.799740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.840256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c587c52-d079-4e7a-aada-6651b8bb14cb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:41.872898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:41.873646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:41.873929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:41.874201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:41.881134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:41.883176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:41.896496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 28 13:54:41.902342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 256/521] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:41.902564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 266/522] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:41.903212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:41.903370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.000244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495054d-d89e-4cef-8f73-f6a600ab3a1e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.000436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afacd2-33cd-438c-afae-98663722fdb0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.032738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.033400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.033718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.033995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.034706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:42.035012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.036381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.037351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.038387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.039341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.039773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.046543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.047971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 257/523] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:42.048290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.048762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.066257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:42.068770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 267/524] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:42.069796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.148163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6d8ba-1e21-4907-bda5-3f31f8898cb1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.169780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c058c-97a0-47f0-82cc-ec3f0c6d561e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.180928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.181618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.181904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.182186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.183016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:42.183321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.184751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.201968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.202754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.203038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.203310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.213638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.215096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.220605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 258/525] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:42.221744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.233426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:42.234670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 268/526] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:42.235451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.321209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2c4c-0780-4761-bf08-61d60c3128eb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.331583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759154c-921d-4221-850a-62c9ddaa036d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.355445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.356247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.356709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.356816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.363573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.365145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.366724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.368096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.368378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.368650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.369428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:42.369765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.371157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.378870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:42.385347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 259/527] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:42.385347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.397680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 269/528] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:42.397680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.479046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7d740-e547-433b-8dda-bb1eaa916fbd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.498690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6501d1f-a618-44dd-8c64-e891049eac5d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.511347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.512004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.512287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.512571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.534820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.535479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.535764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.536039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.536752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:42.537059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.538464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.555775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 270/529] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:42.555775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.579442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.580909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.652634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47e40d-0403-4812-bacf-5a933d044c38 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.680985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 260/530] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:42.685240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.685787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.686007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.686106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.686405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.687122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:42.687435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.689394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.705386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 271/531] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:42.705386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.779227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684d5f-2cb0-4265-8a58-b51893677707 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.800835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ba113-1c96-4912-ba7b-9fcbdf5a2bce None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.813034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.813721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.814009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.814288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.815112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=be883e9492f14daa856a2a9eba500bb4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:42.815432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.816877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.829975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 261/532] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/role_assignments?user.id=be883e9492f14daa856a2a9eba500bb4&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:42.829975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.841001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.841848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.842129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.842404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.850198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.852290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:42.866639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:42.873312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 272/533] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:42.874292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:42.943155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee513e6-abdf-4a4c-ae3f-100491d8b12c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.979575 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:42.980379 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:42.980666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:42.980944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:42.983725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6da4-fad1-4f7a-a72c-3c7bd0964bff None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:42.992679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:42.994187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.012958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:43.014053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 262/534] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:43.014633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:43.020953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.021638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.021924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.022194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.023037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=562f710be70f4e11a67dc65b1adb5c89) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:43.023385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.024935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.030705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 273/535] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:42 2022] GET /identity/v3/role_assignments?user.id=562f710be70f4e11a67dc65b1adb5c89&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:43.031439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:43.139579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b3ca7-bfee-42a4-a287-5b7faf57b82d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:43.176496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.177175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.177502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.177818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.178128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07641d2-4e02-4ff3-ba96-c5e31fd5296d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:43.178609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:43.179071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.181294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.201157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 263/536] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:43.207095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:43.213587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.214265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.214545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.214818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.215544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:43.215848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.217218 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.229687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 274/537] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:43.243222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:43.312367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97850-2419-47a3-b81b-0048f8b798ed None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:43.347827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.348490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.348778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.349052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.349925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=9e91a0ab4e4c4f4d96f357e7770a011a) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:43.350244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.351772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.352366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8671fc-6dd7-4416-a6b5-dc7b3956af5a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:43.358181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 264/538] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/role_assignments?user.id=9e91a0ab4e4c4f4d96f357e7770a011a&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:43.397465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.398361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.398644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.398918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.408089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.409550 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.428092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:43.437758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 275/539] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:43.438315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:43.565478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd47d9-e102-40da-9fc5-a93b16bdaa4d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:43.602144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.602823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.603109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.603388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.604202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:43.604515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.606008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa358a-3451-4b0b-b0f5-dc449dae2d2c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.620637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 265/540] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:43.627635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:43.740384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4860-6963-479b-b430-08311834af37 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:43.777003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:43.777689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.777972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.778248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.779079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=049e46a723a24775a734834e57535201) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:43.779390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:43.780883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b29426-840a-4791-889d-f624a8198f9c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:43.786834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 276/541] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/role_assignments?user.id=049e46a723a24775a734834e57535201&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:43.843122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13dbd-cba5-4ac6-8d3c-001c233e0509 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.843429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13dbd-cba5-4ac6-8d3c-001c233e0509 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.843586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13dbd-cba5-4ac6-8d3c-001c233e0509 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.844963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 266/542] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:43.851788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:43.852070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:43.852350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:43.870246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:43.871457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:43.944123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 277/543] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:43.973043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13dbd-cba5-4ac6-8d3c-001c233e0509 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:44.115171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13dbd-cba5-4ac6-8d3c-001c233e0509 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:44.159357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:44.160149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:44.160425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:44.160695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:44.171656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:44.178604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:44.180175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 267/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:44.185971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:44.327707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970b27d-d861-40fe-b623-c13544f35df4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:44.376891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:44.377822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:44.378249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:44.378681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:44.379714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:44.380165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:44.381717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:44.392556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 278/545] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:44.398353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:44.516423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfca82-a04d-43dc-b891-13ef239fa8ea None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:44.566711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:44.567740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:44.568172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:44.568595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:44.579796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:44.581416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:44.602144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:44.603863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 268/546] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:44.609130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:44.735767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e804bde-6ec0-45af-b87e-676245c7b0d0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:44.769433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:44.770236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:44.770403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:44.770665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:44.771371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:44.771670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:44.773042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:44.785085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 279/547] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:44.790440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:44.903117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025614-ca86-403c-892c-6a668600e85e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:44.937823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:44.938862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:44.939295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:44.939717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:44.948368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:44.950049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:44.963767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 13:54:44.965533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 269/548] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:44.973667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:45.130177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db7c38-e4c8-44bb-a3c9-4759182f1200 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:45.182442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:45.183350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.183780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.184228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.185206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:45.185694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:45.187263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7f7f-e463-4de5-a1ae-633ffe96d4b7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:45.208783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 280/549] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Apr 28 13:54:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:45.214464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:45.355048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481804-1b16-4bf4-b31f-3716624ccd2c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:45.404168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:45.404834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.405115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.405387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.494574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:45.496151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:45.546088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbf4f6-b671-41a1-b776-d4a15468b207 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.546391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbf4f6-b671-41a1-b776-d4a15468b207 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.546638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbf4f6-b671-41a1-b776-d4a15468b207 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.549299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 281/550] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:45.553338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.553792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.554105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.572968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:45.579130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:45.670712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 270/551] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:45.671667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 282/552] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:45.686537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:45.698688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:45.803690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8820-54ca-4c47-addd-7c7b8f88811a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:45.841247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b275fa-bbfa-446f-9a8b-7bb2f40617e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:45.842420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b275fa-bbfa-446f-9a8b-7bb2f40617e7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.842894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b275fa-bbfa-446f-9a8b-7bb2f40617e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.843381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b275fa-bbfa-446f-9a8b-7bb2f40617e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.854303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b275fa-bbfa-446f-9a8b-7bb2f40617e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:45.861598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-49b275fa-bbfa-446f-9a8b-7bb2f40617e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:45.868751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 283/553] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:45.870432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4f6f-a415-4994-a219-3ce8e9402938 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.870919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4f6f-a415-4994-a219-3ce8e9402938 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.871409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4f6f-a415-4994-a219-3ce8e9402938 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.873232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 284/554] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:45.874710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4f6f-a415-4994-a219-3ce8e9402938 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:45.886272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba487690-6fc1-438b-a64e-e40c35ddf450 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:45.922075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:45.923160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.923450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.923730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.937301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:45.939257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:45.960687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c79257c2-e6a7-4fa7-943a-dbf289610c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:45.965651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 271/555] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:45.965651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:45.965651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:45.965651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:45.984125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4f6f-a415-4994-a219-3ce8e9402938 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:45.985114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:45.986532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:46.022646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.023685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.024183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.024644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.025600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:46.026125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.027827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.041438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 285/556] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:46.042632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.063807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 272/557] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:46.064453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.164858 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9bba6-f987-4997-8495-9c604818fb12 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.200908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.202026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.202331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4655229-c6f6-49b0-a227-45845ca6bfb4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.202744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.203232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.204223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:46.204786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.206535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.225400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 286/558] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:46.227486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.249132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.252600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.252877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.253153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.264142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.265585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.282433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:46.288260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 273/559] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:46.289140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.348585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3259954-5430-4436-8d89-2bee2472edd9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.385998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020550d-5451-4cf4-ade1-0467f6ebb87c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.392355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.393390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.394298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.394801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.408023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:46.415010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:46.416340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 287/560] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:46.418427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.421037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.421993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.422273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.422545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.430751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.432234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.445936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1045bd19-f36b-4777-bd14-09b334691915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:46.452218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 274/561] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:46.452218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c241-e857-46e2-8425-e4a75d62f007 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.452218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c241-e857-46e2-8425-e4a75d62f007 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.452218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c241-e857-46e2-8425-e4a75d62f007 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.452218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 275/562] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:46.452218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03c241-e857-46e2-8425-e4a75d62f007 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.526654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be365-9a34-463a-8010-d5a6564c3c7f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.552285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03c241-e857-46e2-8425-e4a75d62f007 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.563757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.564522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.564806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.565073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.565970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:46.566625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.568401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.586851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 288/563] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:46.586851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.590216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.590890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.591587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.591873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.592627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:46.593267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.594315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b6b6-bcba-4c05-8a1e-6a9c4285f679 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.607568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 276/564] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:46.607568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.607568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.607568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.621797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:46.622984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:46.682972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361266-b16f-451c-aa9b-a2089be4d29f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.686359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 277/565] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:46.687191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.715139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.715727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.716008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.716289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.717066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:46.717377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.718846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.730335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 289/566] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:46.731273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.779113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a6649-c350-4749-ad9b-c0ead6f56788 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.811173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.811956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.812239 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.812513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.819168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.820772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.823583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abecfb-53d0-4dd8-bc14-b830fac3189a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.836054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-89cb53b9-72f3-481d-af90-cd64bdfe29f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:54:46.837265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 278/567] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:46.838727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29cd68-e1b5-4402-bda8-d5dc1d8fbbd7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.839012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29cd68-e1b5-4402-bda8-d5dc1d8fbbd7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.839284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29cd68-e1b5-4402-bda8-d5dc1d8fbbd7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.840692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 279/568] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:46.841251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29cd68-e1b5-4402-bda8-d5dc1d8fbbd7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.860396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.861191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.861471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.861782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.872344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:46.873805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:46.889417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:46.890609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 290/569] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:46.891382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:46.936579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29cd68-e1b5-4402-bda8-d5dc1d8fbbd7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.967821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:46.968534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:46.968808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:46.969078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:46.979085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:46.984166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b55a-08a4-46bd-9259-671494c53172 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:46.986133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:46.987304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 280/570] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:46.988053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.014936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.015561 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.015840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.016108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.016923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=ce69ab30e4eb4a46945a5420d85ec611) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.017228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.018673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ad6b-2a59-472f-bda2-23375ac70d64 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.024301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 291/571] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/role_assignments?user.id=ce69ab30e4eb4a46945a5420d85ec611&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.025440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f285-a32d-4802-a263-983514c0826b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.025749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f285-a32d-4802-a263-983514c0826b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.026024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f285-a32d-4802-a263-983514c0826b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.043870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ca00f285-a32d-4802-a263-983514c0826b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:47.045373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ca00f285-a32d-4802-a263-983514c0826b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:47.088800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d44f2c-391b-4e3b-9daa-a1817217797a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.119601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 292/572] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:47.120625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f285-a32d-4802-a263-983514c0826b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.141477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.142978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.143590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.144107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.145298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.145833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.147293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.170736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 281/573] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:54:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.171605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.227213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f285-a32d-4802-a263-983514c0826b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.260856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.261714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.262064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.262407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.263237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.263606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.265029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.272031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc673ca-76f0-48bd-b95b-f90b1c76e320 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.280434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 293/574] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.280434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.306541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.307295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.307574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.307840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.308631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.308874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.310258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.323122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 282/575] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.323122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.377040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b5f0-6bb7-4c7d-94ef-370bab0804bf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.410183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.411198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.411471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.411738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.420141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11980e1-0650-4046-a052-5092bdaa9b3f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.423146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:47.430558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:47.431928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 294/576] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:47.432691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.459361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.460257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.460568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.460843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.471109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.472902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.489567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:47.495804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 283/577] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:47.495804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.545224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0dee-45c8-4f43-b4df-c86e9fe1091a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.577231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.578048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.578326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.578596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] PATH_INFO: `/v3/users/glance` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.587012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.588439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.591703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941eac-e426-490a-89e9-3dd8ec040c7b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.602317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 28 13:54:47.608127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 295/578] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:47.608127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.629378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.630191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.630470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.630743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.641029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.642518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.658965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:47.665298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 284/579] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:47.665298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.703534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac7d17-0cde-417e-af91-ae113f664eba None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.735772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.736435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.736716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.737082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.737859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.738168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.739538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.752134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 296/580] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.752134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.763567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf691ef-afe1-4bdf-9f0c-5f5dca5b9ccc None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.797874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.798554 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.798840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.799119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.799841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.800150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.801592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.818778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 285/581] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.818778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.847625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731dcc8-4396-4468-8c59-4d52dacff7dd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.879122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.879786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.880063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.880338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.881160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.881466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.883525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.900407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 297/582] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.902431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:47.917083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838534a9-b42d-4447-b04c-fbe30badecb7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:47.950979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:47.951772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:47.952157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:47.952535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:47.953351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:47.953788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:47.955278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:47.966193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 286/583] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:47.967245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.003066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d30-7e32-41a5-a379-e230b110dab4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.035502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.036374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.036725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.037069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.047532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.049041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.065482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f4704-5f50-4dd6-b423-f791fc81b4ba None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.066111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:48.067329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 298/584] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.068282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.107010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.107899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.108266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.108614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.117496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.119112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.134078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:48.135750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 287/585] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.136582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.183497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a6d8f-03e0-4eaa-97bb-c15318955dcc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.215595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.216468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.216818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.217170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.227472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.228982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.233870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dbff3-7185-43f9-9b07-e81a20d12151 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.246196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:48.247465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 299/586] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.248239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.269505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.270486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.270767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.271152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.277989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.279493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.293523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 13:54:48.299653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 288/587] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.299653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.347544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4ef6d-9694-480e-bd97-e167a2787d28 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.383974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.384769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.385145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.385521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.386369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:48.386776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.388297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.389190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78adfaa-4bc5-4030-bcc9-916a466b2093 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.405043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 300/588] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:48.405043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.423095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.423758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.424035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.424307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.425082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:48.425389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.426841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.439677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 289/589] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:48.440836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.512220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf8c2-30a7-43f8-8849-f86ff5a312d1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.537434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200e3f-c36a-475d-8e83-7e1ff670898a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.545113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.545802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.546088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.546365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.547089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:48.547395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.548765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.560263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 301/590] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:48.565397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.570410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.571085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.571372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.571650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.572483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:48.572794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.574267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.597830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 290/591] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:48.597830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.671406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa374555-81b2-49a0-8fc7-961126007e01 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.694848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1a917-39d5-4471-b5a6-5eff8a2d0b97 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.704962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.705792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.706064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.706336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.713931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.715361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.729459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 28 13:54:48.730675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 302/592] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.731435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.736482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.737620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.738096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.738559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/be883e9492f14daa856a2a9eba500bb4/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.752976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=be883e9492f14daa856a2a9eba500bb4, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.754711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.767781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 291/593] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:48 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/be883e9492f14daa856a2a9eba500bb4/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:48.768595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.836085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e036b-93a9-4648-874f-15bd89b79a97 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.872730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.874385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.874874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.875338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.883759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.885544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.888297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0b49-301a-4e56-8b54-aeb1be13cd8c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:48.900551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:48.907014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 303/594] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.908247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:48.926342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:48.927272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:48.927546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:48.927826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:48.939232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:48.940802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:48.960102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:48.967080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 292/595] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:48.967950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.016152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf0150-3a72-4869-9af2-bc5eb0bef56f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.050526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.051487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.051968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.052431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.053447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:49.053938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.055553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.068489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e20cae-e975-44e3-9cc4-6d66d07192db None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.075125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 304/596] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:49.076232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.105705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.106549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.106929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.107557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.108342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:49.108778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.110531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.131804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 293/597] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:49.131804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.187441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6111be6-a700-48c0-9330-96e09af0aef1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.221797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.222722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.223194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.223660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.224567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:49.225095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.226719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.230441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce89aa4-e4d2-41d8-98f5-8818eee796ec None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.238911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 305/598] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:49.240020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.279487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.280994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.281481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.282086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.293261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.295024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.311562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:49.313046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 294/599] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:49.313861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.356006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb70f-c6b6-4853-bcb3-bc6c97d7c49b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.388351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6c60f-b561-4233-b25f-b875109cf1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.389672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6c60f-b561-4233-b25f-b875109cf1a5 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.390265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6c60f-b561-4233-b25f-b875109cf1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.390548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6c60f-b561-4233-b25f-b875109cf1a5 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/562f710be70f4e11a67dc65b1adb5c89/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.404461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6c60f-b561-4233-b25f-b875109cf1a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=562f710be70f4e11a67dc65b1adb5c89, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.405922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6c60f-b561-4233-b25f-b875109cf1a5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.410202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f50c6-7f55-4f5e-93ef-977ec9648558 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.417966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 306/600] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:49 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/562f710be70f4e11a67dc65b1adb5c89/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:49.419886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7002-b66a-459e-82d8-a1828068d210 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.420175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7002-b66a-459e-82d8-a1828068d210 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.420452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7002-b66a-459e-82d8-a1828068d210 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.426367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 307/601] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:49.426367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f7002-b66a-459e-82d8-a1828068d210 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.457155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.458081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.458367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.458640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.470189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.472058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.488257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f0c2db81-626f-4971-915a-142b19bae411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:49.490068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 295/602] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:49.495227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.495512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.495790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.515522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:49.516809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:49.573658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f7002-b66a-459e-82d8-a1828068d210 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.590693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 296/603] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:49.591636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.628414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.629361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.629764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.630048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.630803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:49.631110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.632507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.648417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 308/604] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:49.650089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.715614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274f9a-38f2-4635-a740-3b4b1bb0830f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.751251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5401-2102-4f86-a06e-544ff852bdd9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.751799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.752574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.752862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.753188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.754004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:49.754316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.755740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.772504 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 297/605] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:49.773419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.784241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.785040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.785323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.785642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.796823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:49.803898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:49.806029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 309/606] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:49.806795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.877610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e674ebb-df30-400b-8649-f000c2320eea None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.905672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8930-8ac0-4719-98a4-d344c5156bc3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:49.911478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.912272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.912552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.912829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.920561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.922037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.935886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:49.937422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 298/607] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:49.938240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:49.943992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:49.944990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:49.945339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:49.945712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/9e91a0ab4e4c4f4d96f357e7770a011a/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:49.961756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=9e91a0ab4e4c4f4d96f357e7770a011a, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:49.963339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:49.981308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 310/608] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:49 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/9e91a0ab4e4c4f4d96f357e7770a011a/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:49.982402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:50.072044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ae86-ac5a-4070-b881-39d76af2af19 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:50.104377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612978-36cd-4bc6-9040-471f05a89f7b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:50.137888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:50.138590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:50.138870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:50.139147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:50.139984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:50.140272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:50.145598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:50.155416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 311/609] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:50.161308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:50.164345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:50.165262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:50.165725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:50.166149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:50.167096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:50.167577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:50.169137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:50.188814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 299/610] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:50.194582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:50.272096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235635-5046-4164-b58d-29fa717fc093 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:50.316025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:50.317295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:50.317827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:50.318314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/049e46a723a24775a734834e57535201/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:50.334642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=049e46a723a24775a734834e57535201, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:50.336442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:50.352837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 312/611] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:50 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/049e46a723a24775a734834e57535201/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 13:54:50.416921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ac922-8d5a-4fa0-8e4c-5b899456670e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:50.463828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:50.464645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:50.464928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:50.465204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:50.479566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:50.481029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:50.499849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:50.501402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 300/612] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:50.506898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:50.668640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841437fb-2ebf-49a4-a9ba-349454ed5a27 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:50.704563 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:50.705655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:50.706139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:50.706611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:50.707534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:50.708044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:50.709677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:50.723595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 313/613] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:50.729469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:50.860433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bde87-4810-4431-92e8-7eb1bcf20ad1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:50.905044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:50.905886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:50.906223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:50.906507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:50.916934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:50.918406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:50.935271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 13:54:50.936749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 301/614] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:50.942352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:51.071475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93b7d-f5c8-4af4-8951-deda860ca0ee None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:51.121062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:51.121761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.122047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.122321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.123166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:51.123475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:51.124907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3a5b3-06d8-4f88-bb90-0038a2383561 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:51.142613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 314/615] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Apr 28 13:54:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:51.147671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:51.241052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632b67-2583-4371-9270-b10f0ea0b6dc None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.241360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632b67-2583-4371-9270-b10f0ea0b6dc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.242102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632b67-2583-4371-9270-b10f0ea0b6dc None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.243771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 315/616] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:51.248758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81c048-a695-4829-a563-418913476678 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.249048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81c048-a695-4829-a563-418913476678 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.249329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81c048-a695-4829-a563-418913476678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.269941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ed81c048-a695-4829-a563-418913476678 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:51.271126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ed81c048-a695-4829-a563-418913476678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:51.331090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816ded-cd76-4575-8cd7-04072f2b18bd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:51.400541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:51.401349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.401655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.401936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.403273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 316/617] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:51.429672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:51.431133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:51.438705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81c048-a695-4829-a563-418913476678 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:51.463788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:51.465084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 302/618] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:51.472383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:51.570221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81c048-a695-4829-a563-418913476678 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:51.607522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:51.608320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.608602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.608876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.631333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:51.638946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:51.640453 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 317/619] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:51.646043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:51.683309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b0c00-b053-4644-b5ec-aeb4674b8eea None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:51.749455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:51.750533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.751042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.751518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.752441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:51.752955 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:51.755395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:51.791914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 303/620] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:51.797161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:51.815434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d5b2c-f6e8-4869-9c3f-a17e42ae5225 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:51.854506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:51.855537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:51.856659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:51.857134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:51.859500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:51.860054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:51.862321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:51.876147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 318/621] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:51.884674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.000023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdab27-28ad-48dd-95b0-438c28ecb73c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.027723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac505f-0272-4c0c-bf5d-1ae2b1af5af0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.070825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.071028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.071636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.071745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.071928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.072021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.072185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.072280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.079512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.080965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.088216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.089777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.099339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0be2e3ff-e87e-415b-b785-e8290760c1e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:52.106676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 304/622] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:52.107933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114fe5-6e03-42c5-8e5c-8b1fa36068d3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.108221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114fe5-6e03-42c5-8e5c-8b1fa36068d3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.108503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114fe5-6e03-42c5-8e5c-8b1fa36068d3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.109816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:52.110050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 305/623] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:52.111511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 319/624] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:52.117893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.118296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.118521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.118760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.135636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:52.137722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:52.213682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 306/625] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:52.213682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.235082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647fe39-f870-4035-a80e-fda80baf6cc0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.281515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.282452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.282884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.283299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.284268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:52.284999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.286935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.305497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 320/626] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:52.306702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.311740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bae3a6-6e48-47b4-8179-0b3a9a4830d6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.346269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.347114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.347225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.347485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.348207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:52.348516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.350029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.362686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 307/627] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:52.363420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.407608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6956-e8cb-4d06-920b-deedd48d6ca1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.442522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.443690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.444168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.444666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.455649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:52.463629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:52.469586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc3f1-098d-4c23-8eb6-85f3bf6d47a7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.470197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 321/628] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:52.471214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.504086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.504974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.505259 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.505537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/ce69ab30e4eb4a46945a5420d85ec611/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.521122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=ce69ab30e4eb4a46945a5420d85ec611, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.522725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.545621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 308/629] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:54:52 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/ce69ab30e4eb4a46945a5420d85ec611/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:54:52.545621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.637121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d79c2-9d04-4142-9361-11639b4279c4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.707357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.708536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.709017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.709515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.721157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985c96-3fe4-4cce-be2e-61382678fbb2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.730805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.732629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.752754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4f12e2c0-66b6-4af0-8a5e-3cffd626ca7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:54:52.759401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 322/630] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:52.761262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8161e2-3572-49e6-9d02-54b72d4ba28a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.761573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8161e2-3572-49e6-9d02-54b72d4ba28a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.761860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8161e2-3572-49e6-9d02-54b72d4ba28a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.763825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.764517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.764866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.765145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.766037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:52.766347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.767179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 323/631] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:52.767740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a32eb-28db-4200-b246-168e9c7c97e7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.768037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8161e2-3572-49e6-9d02-54b72d4ba28a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.778073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 309/632] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:52.779402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.779695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.779975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.798620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:52.800264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:52.881593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 310/633] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:52.881593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.895152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8161e2-3572-49e6-9d02-54b72d4ba28a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:52.935378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:52.936048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:52.936330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:52.936605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:52.937589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:52.937798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:52.939188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:52.957456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 324/634] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:52.958397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:52.997888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed864984-dc7f-4852-9e2b-27b3883edd51 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.032613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.033804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.034287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.034757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.045677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.047406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.056738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d952ce2-a526-4ac7-b90b-b656cf8dba84 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.065873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:53.067175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 311/635] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:53.068155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.099082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffd44-ce1d-4b48-b181-19e8ed616fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.102408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffd44-ce1d-4b48-b181-19e8ed616fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.102408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffd44-ce1d-4b48-b181-19e8ed616fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.102408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffd44-ce1d-4b48-b181-19e8ed616fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.110932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bffd44-ce1d-4b48-b181-19e8ed616fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:53.118348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-18bffd44-ce1d-4b48-b181-19e8ed616fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:53.124329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 325/636] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:53.125459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1130d3-e80e-4c20-ae8d-5fbf0b41b0b8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.125792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1130d3-e80e-4c20-ae8d-5fbf0b41b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.126046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1130d3-e80e-4c20-ae8d-5fbf0b41b0b8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.127472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 326/637] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:53.127990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1130d3-e80e-4c20-ae8d-5fbf0b41b0b8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.185711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc026e1c-2602-464f-b918-7a49634a459d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.219475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad89b5-0629-4f3d-b6f5-025ca8b2eae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.220317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad89b5-0629-4f3d-b6f5-025ca8b2eae9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.220742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad89b5-0629-4f3d-b6f5-025ca8b2eae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.221192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad89b5-0629-4f3d-b6f5-025ca8b2eae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.224420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1130d3-e80e-4c20-ae8d-5fbf0b41b0b8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.256402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.257095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.257898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.258173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.258889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:53.259195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.260543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.271795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 327/638] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:53.272601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.299670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad89b5-0629-4f3d-b6f5-025ca8b2eae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.301369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad89b5-0629-4f3d-b6f5-025ca8b2eae9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.369715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0af6f4-e742-41c3-9368-9915e506485a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.395644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 312/639] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:53.396997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.397284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.397595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.406095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.407022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.407491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.407767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.408514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:53.408826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.410275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.413021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:53.414770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:53.423391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 328/640] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:53.423391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.484931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 313/641] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:53.495189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.523526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e0ac2-ded9-41a4-afe5-550f5604ba13 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.558117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.558899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.559179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.559450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.566665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.568096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.580946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 28 13:54:53.586667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 329/642] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:53.586667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.604088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35f67-1486-4db8-9be6-3a1b3066a55b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.638001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.639054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.639467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.639882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.650321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.651930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.668985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:53.674972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 314/643] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:53.674972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.677984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39514ba7-855e-4389-8d25-409db48d39ca None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.709823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.711514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.712038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.712508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.723020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.724452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.741234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:53.747538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 330/644] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:53.747538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.777682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6f6e7-9290-4e77-818a-ae0f7569bb34 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.818684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.820110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.820405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.820682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.832445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:53.839532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:53.840909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 315/645] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:53.841585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.856024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671cfb3-fa92-4f75-94aa-eb73d4e1a8d3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.888422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.889085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.889370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.889666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.890494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:53.890802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.892226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.908540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 331/646] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:53.911734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:53.943904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886b3a-f96f-4892-a747-2c090f2aca1c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:53.975693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:53.976351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:53.976633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:53.976908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:53.977645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:53.977953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:53.979319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:53.996086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 316/647] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:53.996086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.005139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a58337-fb29-445a-a161-ffb340a3d789 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.039156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.039812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.040145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.040416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.041181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.041487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.042911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.053870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 332/648] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.055162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.111833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf30e8-befa-4cf1-b60f-1adc9ceec269 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.146155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.146820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.147098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.147371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.148146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.148450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.149832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.157750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 317/649] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.158580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.165162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391511d-2596-4749-aa22-c8eda19a2944 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.197425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.198123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.198404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.198675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.256054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5e4e-bf54-4ef5-b445-36181b970097 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.267715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.269171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.290873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.291669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.291948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.292220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.298994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.300455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.317126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:54.319355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 318/650] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:54.320685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.368974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 333/651] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:54.368974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.425768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795eb4-fc02-440c-94c1-d028142b50de None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.457694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.458482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.458757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.459029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.464216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4899-9375-4432-a02c-ee997b9ddddd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.466878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.468024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.482067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 13:54:54.487995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 319/652] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:54.487995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.502173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.502963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.503245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.503594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.513388 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.514883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.532198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:54.533413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 334/653] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:54.534207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.587976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fb81-4f8f-4db7-bca6-439748d94fe7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.622386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.623043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.623321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.623593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.624369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.624678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.626179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.630474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919185b-26d4-479e-a60c-5fb233492aec None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.637444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 320/654] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.639556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.669734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.670639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.670993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.671276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.680947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.682428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.698619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:54.704059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 335/655] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:54.704059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.747330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0893be4-e973-4892-8330-d1eb5a5c7ad9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.779865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.780452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.780731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.781004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.781859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.782167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.783571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.799986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe49f7-21c0-4f3c-905a-a61155610676 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.806003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 321/656] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.806003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.832983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.833669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.833948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.834222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.834942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.835275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.836636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.847605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 336/657] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.848678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.899781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e216c-1113-41ed-ad71-018c1cb6ac0f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.933483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.934162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.934441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.934712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.935534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=be883e9492f14daa856a2a9eba500bb4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.935863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.937281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.942416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2d324-f347-405f-a3eb-8b8e7fb9fce4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:54.942871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 322/658] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/role_assignments?user.id=be883e9492f14daa856a2a9eba500bb4&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.943629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:54.977040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:54.977747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:54.978025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:54.978299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:54.979052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:54.979357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:54.980756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:54.998151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 337/659] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:54.998151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.045776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492332c-77d2-4780-baa6-e9aedd33efd8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.079941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.080612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.080896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.081170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.095424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783259-c3a9-4d83-ba41-c914ecd86812 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.131611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.132864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.132864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.133034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.140272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.142033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.151905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.153341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.155823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5f93b7e2-67c7-4e43-88ba-0d0ee370c367 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 28 13:54:55.157021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 338/660] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:55.158389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e84686-845f-4cb6-85e1-c6a3d8964fe0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.158672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e84686-845f-4cb6-85e1-c6a3d8964fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.158942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e84686-845f-4cb6-85e1-c6a3d8964fe0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.160314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 339/661] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:55.160924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e84686-845f-4cb6-85e1-c6a3d8964fe0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.250917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 323/662] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:55.251762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.259514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e84686-845f-4cb6-85e1-c6a3d8964fe0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.293363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.294427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.294713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.294985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.301622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.303002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.315765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-15b935bd-13ca-4135-bce2-666ee12e095f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:55.317050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 340/663] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:55.318673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.318673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.318673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.334592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:55.336322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:55.348161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d307-2946-4c57-8642-1af4320049d4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.380815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.381482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.381793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.382100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.382924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:55.383232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.384645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.402303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 324/664] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:55.407155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.410343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 341/665] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:55.410343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.497345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f84c-83e6-4c21-8fe2-822d2fb61dd8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.512528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a7950-f8a9-4ea7-9056-396879d31400 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.529669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.530470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.530734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.531001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.541226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.542689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.546419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.547074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.547358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.547634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.548419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:55.548730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.550183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.559419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:55.560545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 325/666] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:55.561305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.561724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 342/667] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:55.562625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.660059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db235e-f073-411e-be6c-dc84456f0c77 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.661290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b4dc-9000-4264-a0c5-982736524d04 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.692436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.693234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.693516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.693790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.693932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.694963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.695242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.695511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.704532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:55.712156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:54:55.718154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 343/668] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:55.718154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.765467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.766945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.813613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770c5a4-1eb2-444f-b143-8be1ccc03671 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.846503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.847170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.847452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.847731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.848447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:55.848753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.850145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.865839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 344/669] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:55.865839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.866074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 326/670] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:55.866074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:55.960193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf759a6-32cd-4514-885c-39167e812e62 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.962781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa225bdf-1a86-4199-8376-891d803c0c8a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:55.992916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.993608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.993889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.994161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.994893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:55.995194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.995797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:55.996451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:55.996626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:55.996720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:55.997002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:55.997997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=562f710be70f4e11a67dc65b1adb5c89) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:55.998314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:55.999732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.009896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 327/671] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.010070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 345/672] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:55 2022] GET /identity/v3/role_assignments?user.id=562f710be70f4e11a67dc65b1adb5c89&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.010070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.010231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.121130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e470e6-b197-40af-a67e-ac16e9be604f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.132897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffc91d-2597-4ca4-88f8-9053f96bbde1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.160074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.161254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.161784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.162267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.169081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.170198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.170481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.170756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.176119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.178062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.178273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.180264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.196150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:56.197578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 328/673] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:56.198452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:56.199022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.199867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 346/674] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:56.205047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.298609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3fa90-c33e-4ce3-a927-c471c3dc4d23 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.315613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eaea5-ea94-49f6-bed8-8cd0ea738900 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.333294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.334106 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.334391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.334671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.344923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.346387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.351312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.352181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.352650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.353109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.354120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:56.354636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.356246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.363674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:56.365249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 329/675] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:56.366152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.369443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 347/676] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.375074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.465719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049eeb9-ab2c-4b40-a0ec-a35fd427d762 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.473685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14342e-0470-4e5b-800f-c3ae66ac3210 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.501393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.501950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.502210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.502431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.503160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:56.503462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.504880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.510601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.511501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.512011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.512485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.513386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:56.513923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.515543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.516707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 330/677] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.517753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.528502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 348/678] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.529679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.618715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f1d5-af62-4e4e-81b0-6cce2ee0b369 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.629638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40e36-2357-4790-8d17-63a4d5a7c724 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.652467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.653129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.653404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.654999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.656095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=9e91a0ab4e4c4f4d96f357e7770a011a) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:56.656412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.657888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.669580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 331/679] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/role_assignments?user.id=9e91a0ab4e4c4f4d96f357e7770a011a&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.669580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.675259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.676395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.676868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.677331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.688656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.690464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.719613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:56.721543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 349/680] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:56.727778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.770002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013b3b-f653-498a-85df-9df811138bc7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.822537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.826003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.826291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.826626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.843635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.845119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.872368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 13:54:56.873743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 332/681] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:56.879556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:56.903617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956e0cc-65bc-45cf-999d-121d77dc5bfa None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:56.970337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:56.971004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:56.971281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:56.971859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:56.972650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:56.972957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:56.974420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:56.995231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 350/682] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:56.996143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:57.034781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469536e-74d7-44d1-8051-5df0d785e87b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:57.074397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c06d4-a191-4965-a572-000771850d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:57.075077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c06d4-a191-4965-a572-000771850d1c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.075352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c06d4-a191-4965-a572-000771850d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.075622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c06d4-a191-4965-a572-000771850d1c None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.076519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c06d4-a191-4965-a572-000771850d1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:57.076878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c06d4-a191-4965-a572-000771850d1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:57.078333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c06d4-a191-4965-a572-000771850d1c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:57.100874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 333/683] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:57.106579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c06d4-a191-4965-a572-000771850d1c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:57.135266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f689b-3692-49f4-86ed-194d0eed9058 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:57.178478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:57.179442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.179732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.180008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.181027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=049e46a723a24775a734834e57535201) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:57.181944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:57.187341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e963bb-cd2a-4d9a-9762-689ad5862af5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:57.196540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 351/684] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:56 2022] GET /identity/v3/role_assignments?user.id=049e46a723a24775a734834e57535201&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:57.218934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c06d4-a191-4965-a572-000771850d1c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:57.254907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:57.255557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.255841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.256108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.336794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:57.338299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:57.421949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b16a-cd27-4c5d-a928-abb86b940964 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.422900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b16a-cd27-4c5d-a928-abb86b940964 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.423379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b16a-cd27-4c5d-a928-abb86b940964 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.425340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 352/685] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:57.438342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.438658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.438902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.465980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:57.467789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:57.472694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 334/686] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:57.483153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:57.561756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 353/687] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:57.592202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:57.596780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce4e5-1e2d-4e0a-979f-5190db500c20 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:57.633284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:57.634480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.634966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.635441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.648633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:57.650449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:57.668214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:57.670352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 335/688] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:57.679615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:57.724066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec5330-bbf7-4e09-971b-c70155293209 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:57.815267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:57.816159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.816440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.816771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.825237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bedc0f-145f-40e5-a8c6-433222b7caa7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:57.842231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:54:57.850394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:54:57.852728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 354/689] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:54:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:57.858173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:57.893250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:57.893995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:57.894277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:57.894554 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:57.896804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:57.897120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:57.899578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:57.920011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 336/690] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:57.925845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.039205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706f14-e24e-4303-b77a-e3e665be13c5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.050321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10496-d01c-4298-941a-4848080d0b05 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.109940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.110622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.110906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.111180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.111939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:58.112246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.113638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.116256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.117580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.118512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.118512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.129247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.132017 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.134283 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 355/691] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:54:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:58.141167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.164703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:54:58.166113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 337/692] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:58.172400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.310659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538b58-d84c-479f-930f-14a3d85e29b1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.350097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.351467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.351734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.352004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.371514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.372977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.384155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45e6c4-46e8-44c1-bdf5-bcc15bfd2446 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.402489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:58.405700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 356/693] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:58.410933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.444753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.445420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.445726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.446004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.446790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:58.447100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.448544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.463344 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 338/694] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:58.469007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.545258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6041b-d75f-4433-8337-b9a0ea0fdde2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.579137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.579720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.580005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.580280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.580995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:58.581301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.582681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f406be-826b-4773-a6c1-f9bbb140f0d0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.595095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 357/695] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:58.595573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3fce-4ce8-4f71-814d-abcda23898dd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.596391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4b127-e7e0-45a0-970d-61fd3f346822 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.596677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4b127-e7e0-45a0-970d-61fd3f346822 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.596956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4b127-e7e0-45a0-970d-61fd3f346822 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.598455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 358/696] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:54:58.600056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4b127-e7e0-45a0-970d-61fd3f346822 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.641076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.641809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.642025 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.642297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.643126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=ce69ab30e4eb4a46945a5420d85ec611) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:58.643432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.645383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026200-edef-4df4-b8e3-3448efe01756 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.655101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 339/697] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/role_assignments?user.id=ce69ab30e4eb4a46945a5420d85ec611&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:58.656434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.656721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.656998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.692438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:58.693751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:58.754754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4b127-e7e0-45a0-970d-61fd3f346822 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.809802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 340/698] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:54:58.820992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:58.821818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:58.822099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:58.822372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:58.830141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:58.831583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:58.846129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.855842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:54:58.861293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 359/699] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:58.864816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:58.967461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61532-9cb6-476e-9d2a-0c180b2edbbf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:58.986602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc13ed-3622-43d8-b5ea-45253fef86ed None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.002217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.002885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.003165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.003442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.004342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:59.004653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.006154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.022109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.023442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.023718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.023984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.025465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 360/700] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:59.031056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.034676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.036156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.055232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:59.056665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 341/701] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:54:59.062018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.146822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1d7fb-2959-4179-8e7d-7b8fa3532a5d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.184000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.185638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.185747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f732e-6766-47d6-8811-2eff77eebe4d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.186212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.186679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.227130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.227914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.228598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.228884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.229615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:59.229924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.231657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.247305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 342/702] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:54:59.252741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.267727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.269487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.372885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 361/703] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:54:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:54:59.377056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d68592-edab-492f-8b7d-855f90c4db47 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.378234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.410875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.411551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.411834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.412107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.413675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.415108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.439455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 343/704] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:54:59 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:54:59.565083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d4fce-efa7-49a4-876a-31210c51b217 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.601893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.602943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.603390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.603796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.620058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.621844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.644152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9638c989-af9e-482a-850c-428c92c503d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:54:59.645724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 362/705] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:54:59.652111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.713052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559b50-de52-4a08-8824-eb6f933c08ec None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.713784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559b50-de52-4a08-8824-eb6f933c08ec None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.714260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559b50-de52-4a08-8824-eb6f933c08ec None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.716314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 363/706] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:54:59.722307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.722938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.723409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.750382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:54:59.751929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:54:59.782413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b81dd-9501-4c36-a02b-5f254ed860ac None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.816465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.817061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.817343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.817701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.818427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:54:59.818791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:54:59.820727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:54:59.823217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 364/707] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:54:59.838772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 344/708] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:54:59.840063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.854494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:54:59.946673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64569e60-aefc-40dc-97c2-731d89802c5f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.980946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7c51-a671-40fb-972d-05a1983d131c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:54:59.986914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:54:59.988006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:54:59.988480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:54:59.989738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:54:59.999426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.001502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.018685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.019689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.019977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.020303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.020607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-94ee3250-dc30-4574-9a8a-092267c73d03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:00.021047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.022692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 365/709] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:00.022820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.024404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5519c-5af6-4526-ae42-527686dd82dc None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.025107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5519c-5af6-4526-ae42-527686dd82dc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.025618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5519c-5af6-4526-ae42-527686dd82dc None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.027696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 366/710] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:00.028709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5519c-5af6-4526-ae42-527686dd82dc None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.045303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f429d9a7-d7f6-4624-910f-7ccc2afd7bbb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 28 13:55:00.047145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 345/711] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Apr 28 13:54:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:00.053215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.054372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.054855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.072055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:00.073545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:00.148739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 346/712] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:55:00.149939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.166249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5519c-5af6-4526-ae42-527686dd82dc None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.207394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.207975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.208311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.208590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.209428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:00.209799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.211230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.223525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 367/713] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:00.224331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.266165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876f552-279b-485d-93a2-38d5a426f33f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.299955 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.300945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.301503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.301826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.302702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:00.303019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.305537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.311176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 347/714] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:00.312227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.346551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80acd2a-967c-4a62-878f-809735afb9f8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.382790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.384110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.384406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.384936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] PATH_INFO: `/v3/services/network` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.385650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.387754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.404363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 28 13:55:00.409642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 368/715] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:00.410672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.432550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94ef1-2629-4b82-899b-b4982f6ebff1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.480787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.481437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.481759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.482041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.483136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=be883e9492f14daa856a2a9eba500bb4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:00.483452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.485817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.497664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 348/716] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/role_assignments?user.id=be883e9492f14daa856a2a9eba500bb4&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:00.498753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.550914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88f0a6-4429-40a0-9514-a928749b40ea None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.654093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae560cf-d7f2-48d4-9ff6-df9efe021b71 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.654786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.655228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.655228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.655504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.656200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:00.661584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.661584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.680292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 369/717] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:00.703514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.704213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.704500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.704781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.705511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:00.705864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.707291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c778-0f21-4619-97e5-ec17356ef1f0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.718256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 349/718] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:00.723992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:00.834864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833fb7-cad6-44b3-9cda-8b3e830be4eb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:00.873201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:00.874301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:00.874785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:00.875258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:00.876196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] RBAC: Adding query filter params (type=network) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:00.876697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:00.882682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30bead-ec26-4aa6-b461-f194c14c46a9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:00.888316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 370/719] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:01.813081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac161a-65eb-487e-8c1a-5bd100ec78ec None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:01.813620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac161a-65eb-487e-8c1a-5bd100ec78ec None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:01.813734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac161a-65eb-487e-8c1a-5bd100ec78ec None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:01.815260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 350/720] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:01.820745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:01.821142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:01.821305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:01.838674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:01.839867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:01.907325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 371/721] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:55:01.931393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac161a-65eb-487e-8c1a-5bd100ec78ec None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.035176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac161a-65eb-487e-8c1a-5bd100ec78ec None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.070811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.071553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.071834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.072107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.084362 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:02.092078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:02.095612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 351/722] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:02.101584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.202358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedae73-7e32-4726-b4a7-29419e7c976b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.237341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.238041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.238322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.238593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.239334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:02.239636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:02.241608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d7a1-e92a-48e8-a802-50170adad0e8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:02.250227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 372/723] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:02.255832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.308485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93efb-d923-4815-89c4-a71a3bfa17a9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.308799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93efb-d923-4815-89c4-a71a3bfa17a9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.309047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93efb-d923-4815-89c4-a71a3bfa17a9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.310780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 373/724] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:02.316646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.316954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.317199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.345946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:02.347083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:02.489979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4be8d-f2ff-438c-b876-7bafc1030136 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.523353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 374/725] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 13:55:02.526529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.527385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.527660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.527979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.539537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:02.541116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:02.560479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:02.562056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 352/726] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:02.562726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.568604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.732779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26ee78-7063-4129-afd2-ce8b5e590853 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.756244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164689-c484-42a7-abe6-a1805043f157 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.804695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.805322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.805443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.805736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.806006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.806779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:02.807089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:02.807301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.807762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.808255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.808448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:02.818978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:02.821497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 353/727] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:02.826820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.827964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:55:02.829955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 375/728] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:02.835723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.928179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de222e1a-792b-43ca-b0e8-e4a2a00b926a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.938881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb336c79-25e1-465d-80d9-dd9b266647e2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:02.963742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.964548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.964835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.965107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] PATH_INFO: `/v3/users/swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.973596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:02.974132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:02.974898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:02.975326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:02.975700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:02.975970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:02.976635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:02.977036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:02.978599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:02.991542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 13:55:02.993328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 354/729] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:02.997636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 376/730] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:02.999304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:02.999418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.101790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217d2f-325e-4236-9301-3a71cdc18fbb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.136189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.137219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.137730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.138206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.139256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:03.139783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:03.141539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:03.159975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 355/731] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:03.166407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.231684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302b4eb-da21-4500-9c6d-5b520ad18198 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.275728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9dd43-1644-43ac-a3e1-27f8e8b81c5a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.320260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9137553-8987-4f50-9cd7-bfd44f836241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.321833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137553-8987-4f50-9cd7-bfd44f836241 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.323202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137553-8987-4f50-9cd7-bfd44f836241 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.324161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137553-8987-4f50-9cd7-bfd44f836241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.329664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.330724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.331977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.332452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.357064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:03.359679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:03.384163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:03.386034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 377/732] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:03.391616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.467654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9137553-8987-4f50-9cd7-bfd44f836241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:03.469128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9137553-8987-4f50-9cd7-bfd44f836241 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:03.495360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3814e8-b347-4b52-b595-b9a36964e80e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.531657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.532316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.532603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.532883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.533629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:03.533942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:03.535382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378051b-d0cf-4cb2-b7f1-11b84a97ed9a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:03.547538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 378/733] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:03.548568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5e0c-6f92-46a0-b75f-99abdc491bff None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.548854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5e0c-6f92-46a0-b75f-99abdc491bff None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.549128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5e0c-6f92-46a0-b75f-99abdc491bff None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.550518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 379/734] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:03.551440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e20d-991d-48de-9cfe-0a9f9f0b0db5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.551691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e20d-991d-48de-9cfe-0a9f9f0b0db5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.551965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e20d-991d-48de-9cfe-0a9f9f0b0db5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.553151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 380/735] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:03.557752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e20d-991d-48de-9cfe-0a9f9f0b0db5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.589293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 356/736] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:55:03.590916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf27ee-c078-427b-8849-a420f4b685f7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.591200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf27ee-c078-427b-8849-a420f4b685f7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.591475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf27ee-c078-427b-8849-a420f4b685f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.606841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7bbf27ee-c078-427b-8849-a420f4b685f7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:03.608015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7bbf27ee-c078-427b-8849-a420f4b685f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:03.658607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e20d-991d-48de-9cfe-0a9f9f0b0db5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.671684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 357/737] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:55:03.672984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.673272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.673545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.690635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:03.691857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:03.710164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.711838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.712336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.712835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.724358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:03.727272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:03.743417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 13:55:03.745172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 381/738] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:55:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:03.746204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.761270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 358/739] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:55:03.762257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.861264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd03d7-f7b4-47eb-a870-445ad31cc9a4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.868246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85c40e-dfda-4c01-aa2b-538239cf583f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:03.894513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.895302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.895578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.895852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.900425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:03.901210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:03.901481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:03.901775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:03.905413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:03.911091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:03.912227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:03.912517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:03.913969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 359/740] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:03.914726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:03.930863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:03.932034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 382/741] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:03.932771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.010337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043258-1795-404e-8c84-2a16241c6581 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.022395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a71e-53fa-43eb-b162-ebbff10ab3c4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.041100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.041781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.042067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.042341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.043171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:04.043478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.045148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b037f5-2856-4555-9e29-4c3d0e568123 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.054618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.055260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.055540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.055812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.056519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.057910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.066960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 360/742] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Apr 28 13:55:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:04.066960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d497ed-12a8-4aab-9223-085ecccf5827 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.066960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d497ed-12a8-4aab-9223-085ecccf5827 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.066960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d497ed-12a8-4aab-9223-085ecccf5827 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.066960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 361/743] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:04.066960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d497ed-12a8-4aab-9223-085ecccf5827 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.075809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 383/744] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:03 2022] POST /identity/v3/services => generated 251 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:04.076623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.194287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d497ed-12a8-4aab-9223-085ecccf5827 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.197871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10190ac5-e53e-48e2-8b24-8cdd3fecfe4a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.229801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.230479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.230756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.231026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.231774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:04.232076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.233235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.233450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.233945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.234228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.234501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.235237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:04.235545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.236953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53af9a-4046-4fdc-845a-75fcfac17685 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.247766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 362/745] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:04.247766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.255275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 384/746] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:04.257598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.257598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.257813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.274988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:04.276444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:04.350272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 385/747] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 13:55:04.351217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c60c0-8395-412a-a7bb-4ca93dbf73be None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.351524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.384652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.385311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.385618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.385926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.450681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.452097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.460158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58660-1149-4625-8e5f-d9ed71016989 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.492363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.493161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.493438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.493740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.503564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.504993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.521668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:04.522909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 386/748] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:04.523673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.550273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 363/749] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 13:55:04.551116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.621354 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba7b0-516d-4ac3-bb66-357574bd4ca4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.649434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fbac-b607-4108-a0fd-7219b64212ce None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.655247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.656259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.656750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.657228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.664496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.666062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.679521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:04.682542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.683204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.683483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.683757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.684466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.685900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.686000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 387/750] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:04.686833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.702269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 364/751] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:04 2022] POST /identity/v3/services => generated 240 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:04.703847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.818356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebc2ea-19b2-48ff-951a-614795c0f1bd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.840983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1572-d605-4120-a8b7-933bf68cbec3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:04.858464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.859559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.860049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.860547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.861529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:04.862069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.863685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.877856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:04.878677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:04.878957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:04.879248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:04.881166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 388/752] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:04.882634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.895482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:04.896946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:04.915564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:04.917290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 365/753] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:04.918183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:04.995075 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcd99-d05c-49ea-9720-caf1c2896a04 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.018950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617e35f-5bb9-4987-8fd2-9a55da663ba1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.029239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.030114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.030542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.030996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.031944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.032402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.033987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.046762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 389/754] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:05.047850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.054169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.054966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.055247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.055522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.063185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.064624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.077849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:55:05.079057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 366/755] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:55:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:05.079903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.170488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d280a89-8034-45b7-a814-0368cf6a5ae3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.195196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6830d0d-45a8-4673-bb07-3911f3176913 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.212897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.213717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.213860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.214118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.214842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.215148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.216517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.228422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 390/756] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:05.229061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.231895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.232726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.233153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.233796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.234805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=ce69ab30e4eb4a46945a5420d85ec611) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.235269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.236854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.244101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 367/757] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/role_assignments?user.id=ce69ab30e4eb4a46945a5420d85ec611&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:05.245398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.337207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01afd-1693-4ee2-9ecc-76b49b70d49f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.350837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb272e03-cf5f-4e60-a63f-9fb4b6be62b7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.372966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.373660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.373947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.374276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.375120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.375432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.376855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.388324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.389379 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.389843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.390264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.394658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 391/758] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:05.400138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.400324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.402066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.416834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:05.418664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 368/759] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:05.435457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.541600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1185e-e951-454b-9bd1-c7fd2837fc2a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.576940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.578019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.578301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.578574 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.591757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.593459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.597603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10a74-f4ab-4920-ab50-ce17ef510f53 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.614868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:05.617178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 392/760] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:05.623475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.647770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.648442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.648718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.648996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.649813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.650125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.651556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.673153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 369/761] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:05.679707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.787343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42db2a-4047-46ea-9a31-e7fcf602c51d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.790073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea298-034a-41bf-9e45-6af059cafacf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:05.825808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.826528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.826905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.827276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.828099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.828495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.829989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.832366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:05.833021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:05.833299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:05.833584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:05.834432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=c8489bced3994d299e7edc9af7b1326d) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:05.834776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:05.836195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:05.842204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 370/762] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/role_assignments?user.id=c8489bced3994d299e7edc9af7b1326d&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:05.842674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 393/763] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:05.855314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:05.966109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9df80b-088a-4f65-8deb-7c295ae8e5bf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:06.002533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:06.003364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:06.003645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:06.003919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:06.012635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:06.014148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:06.029009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:06.030654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 371/764] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:06.036391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:06.141652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34637-ff78-43f7-b069-e7e5816b7e5c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:06.175754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:06.176413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:06.176694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:06.176969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:06.177776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:06.178086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:06.180081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd29bcd-8187-4d45-a28c-2197ed86d45e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:06.192415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 394/765] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:06.198254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:06.297464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da2660-8ccf-44d6-a65c-b9a27275b804 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:06.331502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632b02a-9d8d-43e2-ad6a-e0b57e97d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:06.332389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b02a-9d8d-43e2-ad6a-e0b57e97d91f None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:06.332669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b02a-9d8d-43e2-ad6a-e0b57e97d91f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:06.332945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b02a-9d8d-43e2-ad6a-e0b57e97d91f None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/be883e9492f14daa856a2a9eba500bb4/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:06.334988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632b02a-9d8d-43e2-ad6a-e0b57e97d91f None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=be883e9492f14daa856a2a9eba500bb4, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:06.336419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632b02a-9d8d-43e2-ad6a-e0b57e97d91f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:06.360779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 372/766] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:06 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/be883e9492f14daa856a2a9eba500bb4/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:55:06.816932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb08a8-c821-4bea-aef8-ecda67e86840 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:06.817308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb08a8-c821-4bea-aef8-ecda67e86840 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:06.817487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb08a8-c821-4bea-aef8-ecda67e86840 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:06.819133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 395/767] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:06.824475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:06.824768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:06.825046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:06.841847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:06.843041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:06.911404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 373/768] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:06.934776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb08a8-c821-4bea-aef8-ecda67e86840 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:07.045653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb08a8-c821-4bea-aef8-ecda67e86840 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:07.095449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:07.095449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.095899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.095899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.096492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:07.099869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:07.116602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2947804f-a708-4ff9-b5ad-b08ccbb74269 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 28 13:55:07.118174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 396/769] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Apr 28 13:55:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:07.124206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:07.223846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e486a4-f8e1-4264-8e04-72c8ebd55c80 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:07.259345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:07.260016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.260301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.260576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.261285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:07.261605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:07.262959 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:07.267878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 374/770] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Apr 28 13:55:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:07.273755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7505-76a1-4a4f-b88f-98ce33d78da1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.274044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7505-76a1-4a4f-b88f-98ce33d78da1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.274316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7505-76a1-4a4f-b88f-98ce33d78da1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.275817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 397/771] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:07.276517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:07.280564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625671df-1afe-471d-85cb-44591637db7c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.281082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625671df-1afe-471d-85cb-44591637db7c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.281593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625671df-1afe-471d-85cb-44591637db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.313372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-625671df-1afe-471d-85cb-44591637db7c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:07.314936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-625671df-1afe-471d-85cb-44591637db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:07.375436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b4364-77b2-43fc-8508-83fc937adf09 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:07.409738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:07.410408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.410691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.410969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.411679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:07.411985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:07.413374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:07.419912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 375/772] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Apr 28 13:55:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:07.425510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:07.481636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 398/773] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:07.517573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625671df-1afe-471d-85cb-44591637db7c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:07.526751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc3a66-19a6-40c2-9a84-4544121f7617 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:07.565025 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:07.565719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.566005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.566283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.567069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] RBAC: Adding query filter params (interface=public, service_id=f349234cd342483faf3bfefe61eac5b1, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:07.567385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:07.568757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:07.576787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 376/774] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:07 2022] GET /identity/v3/endpoints?service_id=f349234cd342483faf3bfefe61eac5b1&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:07.582028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:07.682619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625671df-1afe-471d-85cb-44591637db7c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:07.744015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0013fd-af07-4d4c-8d30-f16d78c7098f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:07.779532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:07.780584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.781139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.781654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.782600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:07.784212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:07.791184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 377/775] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:07 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:07.896375 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:07.897758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:07.898037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:07.898310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] PATH_INFO: `/v3/services/network` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:07.898995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:07.900392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:07.911966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7677c566-ce3b-416a-a39f-7e483b777e05 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 28 13:55:07.914137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 399/776] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:07 2022] GET /identity/v3/services/network => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:07.920104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.015189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52b81-420d-45b7-a7f7-a1fc8e40a9af None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.015489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52b81-420d-45b7-a7f7-a1fc8e40a9af None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.015655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52b81-420d-45b7-a7f7-a1fc8e40a9af None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.017346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 400/777] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:08.023508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.023808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.024109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.041585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:08.043073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:08.082906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb4c3-1d23-453e-8dbe-0a1f9f326c54 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.120065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.120777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.121055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.121378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.122186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] RBAC: Adding query filter params (name=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:08.122491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:08.123849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:08.128918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 378/778] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:08.134565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.143584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 401/779] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:08.171424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.291574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69a212-11d9-478b-9c9e-ac2746dfcd8d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.309886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db04fb2-b06a-47a3-99c1-7b2f9ac703c4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.346294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.347085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.347363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.347628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.354428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.355104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.355385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.355659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.356368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] RBAC: Adding query filter params (type=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:08.356679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:08.358073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:08.358255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:08.365221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:08.367653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 402/780] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:08.373513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.374847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 379/781] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:08.387457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.500557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe992eb-2210-4dfc-8f1e-02e5d66bac47 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.506919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b935278-266d-4b76-994f-aa57d99aa1fc None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.538090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.541351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.542543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.543026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.544914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:08.546967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:08.548557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:08.553126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.554587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.555070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.555598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.557260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] RBAC: Adding query filter params (interface=public, service_id=ff3b0a60dff243b3881855e2682f701e, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:08.560310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:08.561924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:08.569497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 403/782] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:08.571759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 380/783] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/endpoints?service_id=ff3b0a60dff243b3881855e2682f701e&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:08.573004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.578306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.690450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf207e-348b-4517-9344-623241e17a3a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.735118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.738896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.739420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.739953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.742956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:08.744624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:08.756868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 381/784] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:08.788898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03119303-8812-43a3-be96-c5b94cc5ea11 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:08.834485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:08.835654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.836137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.836625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.849546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:08.855021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:08.874287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d953f709-f275-4563-99d1-74e1cb0db82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:08.876297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 404/785] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:08.882291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:08.971006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff5e5-a9c0-4de8-b32c-759cc655003e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.971831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff5e5-a9c0-4de8-b32c-759cc655003e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.972341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff5e5-a9c0-4de8-b32c-759cc655003e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:08.974505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 405/786] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:08.981045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:08.981635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:08.982279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.005983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:09.008511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:09.015278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c798c-95d3-4e09-9af8-c55d7410c9c3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.050995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.051659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.051936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.052211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.053928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:09.054130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.055858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.068235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 382/787] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:09.074603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.099424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 406/788] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:09.129175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.206462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bfaba-41f8-470b-8eb3-fefb69bcbfd2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.227769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4092e9-b6bb-4c5f-bfac-d437bb3de415 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.252476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.253994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.254278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.255423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.264269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.269589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.278383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.279373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.279654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.279922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.294798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 13:55:09.296163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 383/789] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:09.302222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.314682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:09.321769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:55:09.323027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 407/790] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:09.330720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.411213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d07eb-173e-4c9f-9c3c-9fc233271c15 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.449423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.450641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.451104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.451597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.452610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:09.453093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.455097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.475969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 384/791] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:09.482509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.532111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef97754-8b59-48a9-afa4-8be9b267a51b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.567070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.568052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.568528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.569591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.570512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:09.570991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.572512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb5f7-9852-47e6-bc7f-5bad40902811 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.581041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 408/792] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:09.582569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c35c1-695a-431e-a393-bc77b7e56825 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.583068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c35c1-695a-431e-a393-bc77b7e56825 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.583520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c35c1-695a-431e-a393-bc77b7e56825 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.585243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 409/793] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:09.586133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c35c1-695a-431e-a393-bc77b7e56825 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.602231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a1bb-5e40-4c5a-9d17-da4fa644fc6a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.636878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.638048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.638160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.638420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.648564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.650148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.667675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-d45f76cc-5f31-4069-be1e-4917e3848fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:09.673912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 385/794] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:09.673912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.673912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.673912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.690147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:09.691513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:09.695395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c35c1-695a-431e-a393-bc77b7e56825 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.728324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.729432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.729927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.730372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.741386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.743065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.760320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:09.762110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 410/796] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:09.763110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.766425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 386/796] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:09.768033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.863314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f6e22-45d5-4f0a-b943-636ce10d283b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.886982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74da40-1b09-4207-9b30-0471b399102d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:09.897979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.899195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.899703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.900351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.901767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:09.902514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.904510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.920858 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 411/797] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:09.922000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:09.926311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:09.926985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:09.927274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:09.927549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:09.928905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:09.929222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:09.930620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:09.942566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 387/798] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:09.943464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.046413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b138f5-b1de-4804-9135-143f5109dda0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.059811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7bb30-f2c9-4803-8e77-9e66361ff4db None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.089600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.090797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.091406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.091885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.097439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.098312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.098586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.098868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.104182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:10.111840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:10.113141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.114051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 412/799] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:10.115070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.117006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.142472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:10.145630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 388/800] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:10.146639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.223682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887f60-7f37-4b72-a283-5d047d6e8398 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.252858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156a07-2c9b-4c4c-aa0d-0507c3dccdda None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.258699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.260048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.260536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.260997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.268799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.270532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.284552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 13:55:10.286481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 413/801] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:10.287496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.287768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.288537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.288828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.289126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.289901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:10.290212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.291758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.305395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 389/802] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:10.306291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.389486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232c5c-476f-4efe-99e1-9387a275476e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.408849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161460-0d4b-47d3-a579-f7f1408350f5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.425403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.426441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.426934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.427419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.428969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:10.429475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.431220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.444632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.444926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 414/803] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:10.445984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.450135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.450426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.450710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.451557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:10.451872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.454064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.471895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 390/804] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:10.472764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.549908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d84b-d632-43e8-a776-cf83f19fe3d3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.573039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d70b4b-0121-4182-b52b-9be27fca8f2a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.583438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.584220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.584529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.584788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.594842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.596323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.606514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbbb59-1001-4058-b21e-98bb083ac8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.607395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbbb59-1001-4058-b21e-98bb083ac8f8 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.607671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbbb59-1001-4058-b21e-98bb083ac8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.607944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbbb59-1001-4058-b21e-98bb083ac8f8 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/ce69ab30e4eb4a46945a5420d85ec611/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.609912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbbb59-1001-4058-b21e-98bb083ac8f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=ce69ab30e4eb4a46945a5420d85ec611, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.611315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbbb59-1001-4058-b21e-98bb083ac8f8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.613303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:10.614539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 415/805] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:10.615310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.628719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 391/806] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:10 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/ce69ab30e4eb4a46945a5420d85ec611/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:55:10.629855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f40e6-5c49-463a-b34d-5bb02b02e39b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.630139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f40e6-5c49-463a-b34d-5bb02b02e39b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.630411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f40e6-5c49-463a-b34d-5bb02b02e39b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.631898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 392/807] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:10.636630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f40e6-5c49-463a-b34d-5bb02b02e39b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.747811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece07eb-f8d6-4696-b70f-c526af1c5cc2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.770885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f40e6-5c49-463a-b34d-5bb02b02e39b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.785740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.786537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.786811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.787075 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.798699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.800229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.815732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.816412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.816698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.816974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.817738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:10.818050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.818671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0c63e20a-0208-40ae-9b24-919ede35aecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:10.819468 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.820337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 416/808] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:10.821667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.821951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.822223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.833697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 393/809] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:10.835027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.841506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:10.842711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:10.920978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 417/810] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:10.922006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:10.941868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4185a-d190-43a2-90cb-1e428ce80ef8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:10.976406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:10.977428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:10.977934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:10.978413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:10.979335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:10.979833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:10.981391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:10.993856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 394/811] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:10.999215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.021401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be78d0-d233-48b5-b9be-ac5eada96ef5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.057076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.057771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.058050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.058319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.065867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.067454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.081760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:55:11.088758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 418/812] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:11.088758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.126818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b579-7165-4d76-9848-4fed65619ebf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.166072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.167270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.167911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.168727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.170124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.172404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.187368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 28 13:55:11.189072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 395/813] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Apr 28 13:55:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:11.190698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.207193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98362-5f7d-4aa4-97bf-2910d14a37e3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.241319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.242237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.242582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.242917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.249616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.251108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.265351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:11.271293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 419/814] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:11.272257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.310178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51455c-55d8-458e-a939-161ea8cdf3f1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.341140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.341839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.342120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.342394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.343220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:11.343526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.344935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.361843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 396/815] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:11.362645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.375203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a733a-f465-4615-aaca-52aa09c2c35a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.408063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.409019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.409298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.409584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.410300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:11.410604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.411956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f8165-419a-41d2-a2c2-b7cd83ffdacc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.421630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 420/816] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:11.423180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47baee-d98b-4fae-a731-c9a6833bb9ce None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.423466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47baee-d98b-4fae-a731-c9a6833bb9ce None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.423741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47baee-d98b-4fae-a731-c9a6833bb9ce None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.425113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 421/817] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:11.425818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47baee-d98b-4fae-a731-c9a6833bb9ce None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.459329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182141-8452-4ccc-bf06-5405091012e8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.492524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.493190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.493472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.493774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.494554 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:11.494865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.496287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.509027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 397/818] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:11.509027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.527255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47baee-d98b-4fae-a731-c9a6833bb9ce None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.562846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.563415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.563691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.563960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.614115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308ab15-591b-47fb-a674-17cc1c177592 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.628923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.630464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.647483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.648205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.648490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.648765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.649510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:11.649849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.651198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce94d9c-ecb0-4243-9236-8e8e0b3de86c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.660123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 398/819] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:11.660123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.660123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.660123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.674591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:11.675768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:11.734813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 422/820] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:11.734813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.755467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 399/821] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:11.755467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.833302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b409-5fd6-4afc-bc73-b969bfa2a46a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.858356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3812-dec6-48cc-afe8-cc79f76a2b63 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:11.868182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.869148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.869608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.869850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/c8489bced3994d299e7edc9af7b1326d/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.885026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=c8489bced3994d299e7edc9af7b1326d, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.886498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.896018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:11.897211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:11.897503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:11.897808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:11.898542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:11.909939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 423/822] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:11 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/c8489bced3994d299e7edc9af7b1326d/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:55:11.909939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:11.910243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:11.934457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 400/823] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:11.935544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.129989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce05b-0580-45b0-a338-dda7cb8b5b26 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.154689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe49bf-7442-41de-b2b5-7126cc3539b1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.167354 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.168489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.169233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.169769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.188281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.189790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.201413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.202249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.202530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.202804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] PATH_INFO: `/v3/services/network` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.203650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.204825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.214622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:12.216429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 424/824] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:12.216830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 28 13:55:12.221588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 401/825] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:11 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:12.222619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.226414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.345733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868240a0-3dd1-4932-8a57-0387ff0fc033 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.347550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b6b6-22f8-41e0-809a-78ae1d15a649 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.386831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.387357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.387526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.387782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.388067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.388746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.388848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] RBAC: Adding query filter params (name=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:12.389067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.389460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.389923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.390457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.390980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:12.391631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.393784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.397649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 402/826] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:12.402517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.408208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 425/827] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:12.417432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.507727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5863a-3d7f-4d33-9654-8e2658de1632 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.528884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206703c-fe64-457d-aca0-3e51a3d4b223 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.540981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.541870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.542292 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.542730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.543586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] RBAC: Adding query filter params (type=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:12.544319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.545839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.551216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 403/828] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:12.557490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.563943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.564745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.565023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.565296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.572896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.574406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.588971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:12.590497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 426/829] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:12.598512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:12.717235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f57558-c746-407b-b9ee-e2f45667dc74 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.754580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.757584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.757584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.757584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.757864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.759497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.781972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6df2b-f556-486f-9133-2a0bc82cbc15 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:12.795487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 404/830] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:12.847822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:12.848498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:12.848830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:12.849051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:12.850483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:12.850797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:12.852253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf485e-b470-4872-a941-b392d2dac8d1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:12.869430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 427/831] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:12.875607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:13.011197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22c770-e29a-4f2c-a198-09e20dcd7823 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:13.046732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:13.047669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.048091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.048505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.049479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=be883e9492f14daa856a2a9eba500bb4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:13.049976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:13.051573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30f429-52df-4890-a4b1-46ca5bd8fa2e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:13.059241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 405/832] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:12 2022] GET /identity/v3/role_assignments?user.id=be883e9492f14daa856a2a9eba500bb4&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:13.126649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53468b7-84f1-444f-b39f-65d904f14144 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.126952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53468b7-84f1-444f-b39f-65d904f14144 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.127287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53468b7-84f1-444f-b39f-65d904f14144 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.132318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 428/833] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:13.138250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.138565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.138816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.168001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:13.169491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:13.263102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 406/834] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:13.289190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53468b7-84f1-444f-b39f-65d904f14144 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:13.407044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53468b7-84f1-444f-b39f-65d904f14144 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:13.440071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:13.440877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.441155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.441428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.453391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:13.461190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:13.462780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 429/835] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:13.468263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:13.564047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b749c8-96e4-4255-95f1-67a86a4c7b34 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:13.605684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:13.606724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.607213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.607679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.608708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:13.609230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:13.610814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:13.620557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 407/836] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:13.625906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:13.724700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32816-43df-4ab2-ad7e-1c0421bc1ff7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:13.757406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:13.758228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.758509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.758782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.769165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:13.770628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:13.791403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:13.793201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 430/837] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:13.798832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:13.900284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ec05-5371-4753-85e7-86a8d6e2d887 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:13.937803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:13.938467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:13.938746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:13.939018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:13.939729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:13.940031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:13.941385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:13.953936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 408/838] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:13.962692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.061209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e733e-3310-46ee-94a4-935e658a7827 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:14.096415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:14.097200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.097475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.097773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.105875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:14.107300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:14.121140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 13:55:14.122645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 431/839] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:14.132710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.232153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b269a-f2fc-4fa0-a42f-4004364f8fed None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:14.266223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:14.266894 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.267173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.267447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.268275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:14.268582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:14.270015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499da68f-581e-41f4-b07f-00a79c2a88f6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:14.287912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 409/840] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:14.294879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.399650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc939-5cd9-44de-a7d2-45e6e2a3af51 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:14.437446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc934b-dbef-4ad4-b33a-5f88b9ddd9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:14.438278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc934b-dbef-4ad4-b33a-5f88b9ddd9ae None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.438440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc934b-dbef-4ad4-b33a-5f88b9ddd9ae None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.438679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc934b-dbef-4ad4-b33a-5f88b9ddd9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.507863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc934b-dbef-4ad4-b33a-5f88b9ddd9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:14.509303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc934b-dbef-4ad4-b33a-5f88b9ddd9ae None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:14.547628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf9f7-fbd9-446d-85e4-472c1da633d8 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.548265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf9f7-fbd9-446d-85e4-472c1da633d8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.548265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf9f7-fbd9-446d-85e4-472c1da633d8 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.550213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 410/841] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:14.555865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0b67-47a1-428d-af32-fe3b324c35e7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.556164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0b67-47a1-428d-af32-fe3b324c35e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.556441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0b67-47a1-428d-af32-fe3b324c35e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.572606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-485e0b67-47a1-428d-af32-fe3b324c35e7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:14.574028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-485e0b67-47a1-428d-af32-fe3b324c35e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:14.614181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 432/842] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:14.620791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bb842-3143-4587-8a0c-2ff43ebfae7e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.621083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bb842-3143-4587-8a0c-2ff43ebfae7e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.621725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bb842-3143-4587-8a0c-2ff43ebfae7e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.623110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 433/843] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:14.623820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bb842-3143-4587-8a0c-2ff43ebfae7e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.646060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 411/844] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:14.647816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.648107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.648381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.664410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:14.665518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:14.728748 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 412/845] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:14.729839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.739222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bb842-3143-4587-8a0c-2ff43ebfae7e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:14.777787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:14.778602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.778941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.779213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.788893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:14.790343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:14.807958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:14.809319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 434/846] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:14.812297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.834962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4d931-68ba-4052-82b5-abc54cad569b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:14.870686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:14.872039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.872323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.872597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.884918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:14.894002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:55:14.900360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 413/847] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:14.900360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:14.906493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce8f25-cf5a-4c50-9f20-2ca27818fbbe None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:14.939464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:14.940183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:14.940462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:14.940736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:14.941388 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:14.942801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:14.954145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 28 13:55:14.955327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 435/848] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:14.956090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.011196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3baa-2e09-43ec-b41c-b458daf98473 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.045568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.046236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.046519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.046798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.047546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.047851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.049213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.054080 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f87fb-2749-49c4-8935-80153cceb6ef None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.065729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 414/849] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.065729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.090582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.091250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.091532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.091806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.095418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.095418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.095418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.106231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 436/850] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:55:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.106886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.175529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a78e6-ae8d-4e48-a65d-b2abfa04cef9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.208975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.209624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.209916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.210196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.210902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.211211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.212330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b926ac-51a8-429c-af6f-a67a9cb47db7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.212578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.222005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 415/851] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.222826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.251304 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.252093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.252369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.252640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.259384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.261023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.274446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:15.276212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 437/852] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:15.277205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.324317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66de5-c242-44b1-8ef5-ca8d18bb8204 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.356623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.357411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.357725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.358001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.368553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.370053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.375499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e48ea-ddda-4557-8a3e-86763c5211b7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.388353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:15.389669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 416/853] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:15.394716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.413760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.414817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.415306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.415782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.416686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.417207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.418694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.429982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 438/854] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.431922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.509060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5df81-9efa-4a22-aaa9-1c14271c5d58 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.549783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.551324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.551812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.552297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.553956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.554529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.556246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6116e5-fb31-4e34-87dd-7c19373ea6bb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.558373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a726cb-29ef-4d29-954b-df5874f4e9af None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.576408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 417/855] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.576408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a44df-b3ff-49b7-b945-3c34f1daa27c None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.576408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a44df-b3ff-49b7-b945-3c34f1daa27c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.576408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a44df-b3ff-49b7-b945-3c34f1daa27c None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.577503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 418/856] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:15.581216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a44df-b3ff-49b7-b945-3c34f1daa27c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.607262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.607938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.608227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.608504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.609230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.609539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.610933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0f9b5-1c1e-45dd-82d8-8dfd0fbe50c2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.625878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 439/857] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.627164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.627455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.627733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.649661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:15.650797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:15.692482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a44df-b3ff-49b7-b945-3c34f1daa27c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.719810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 440/858] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:15.720957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.733003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.733905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.734193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.734476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.735591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=ce69ab30e4eb4a46945a5420d85ec611) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:15.735915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.738059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.745321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 419/859] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/role_assignments?user.id=ce69ab30e4eb4a46945a5420d85ec611&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:15.746175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.831845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704545-f128-404e-ac4f-d7fdc8e09329 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.871648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.872486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.872767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.873547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.884207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.885744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.886889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c14e5-4c06-47a2-ad9c-4797d05a87bd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:15.905189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 13:55:15.909729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 441/860] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:15.912704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:15.928236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:15.929052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:15.929331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:15.929630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:15.930282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:15.931638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:15.945603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 28 13:55:15.946977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 420/861] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:15.954059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:16.121645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7841943-3d9a-43de-b7c8-3243ebafa728 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:16.141090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f295dcb-f5f7-44fd-9173-73cdbe8168e4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:16.224169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:16.225106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:16.225237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:16.225455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:16.226384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:16.229575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:16.238583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:16.241577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:16.241577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:16.241577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:16.241577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:16.241904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:16.241974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:16.243329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:16.261648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 421/862] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:16.261648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:16.281583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 442/863] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Apr 28 13:55:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:16.283737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:16.423358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8880d3-d24d-4f94-8ec9-ad5d88d73252 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:16.481886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:16.482904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:16.483385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:16.483853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:16.496128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4be6-1ecf-498f-be3c-43fe45256988 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:16.574946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:16.576406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:16.576889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:16.577363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:16.578306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:16.579081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:16.580466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:16.590641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 422/864] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:16.594690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:16.596171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:16.703357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 443/865] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:16.710757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:16.820250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e20650-f04b-4091-b32f-a781a6a66ea1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:16.853483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:16.854308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:16.854591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:16.854863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:16.866035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:16.867532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:16.884073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:16.885592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 423/866] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:16.894648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:16.993257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b525c8-18ce-4a08-ba8c-5df1662af3ce None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:17.030100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:17.031031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:17.031457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:17.031866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:17.032727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:17.033168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:17.034693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:17.047423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 444/867] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:17.052826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:17.159114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f407-7257-4cfc-ba14-7dbbb1dc161a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:17.192047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:17.192890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:17.193182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:17.193487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:17.200035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:17.201463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:17.216273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:17.221674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 424/868] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:17.223563 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:17.321363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b1bb-d221-4834-ae4d-d844dfeccc57 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:17.359086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:17.359750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:17.360034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:17.360310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:17.361098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:17.361411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:17.362881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d41b1-7657-45ec-995b-4e554f1bb287 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:17.380696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 445/869] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:17.382138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:17.485440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ec781-df4e-4827-b800-29fed428fa04 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:17.524236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:17.525261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:17.525857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:17.526337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:17.527599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=c8489bced3994d299e7edc9af7b1326d) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:17.528473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:17.530806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f259-1d07-49ce-b0a9-f5a8a4e4b663 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:17.538015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 425/870] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:17 2022] GET /identity/v3/role_assignments?user.id=c8489bced3994d299e7edc9af7b1326d&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:17.811268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca756-f3ee-4c31-a4e3-b4c4bb40b3a6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:17.811776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca756-f3ee-4c31-a4e3-b4c4bb40b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:17.811881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca756-f3ee-4c31-a4e3-b4c4bb40b3a6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:17.813310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 446/871] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:17.819301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20dfa1-bae0-4555-b254-650c790500d3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:17.819746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20dfa1-bae0-4555-b254-650c790500d3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:17.819822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20dfa1-bae0-4555-b254-650c790500d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:17.836552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fa20dfa1-bae0-4555-b254-650c790500d3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:17.838083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fa20dfa1-bae0-4555-b254-650c790500d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:17.909320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 426/872] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:17.932701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ca756-f3ee-4c31-a4e3-b4c4bb40b3a6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:18.039402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ca756-f3ee-4c31-a4e3-b4c4bb40b3a6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:18.077014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92335826-81de-4c91-b0c9-38438802c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:18.077691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92335826-81de-4c91-b0c9-38438802c37d None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:18.077977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92335826-81de-4c91-b0c9-38438802c37d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:18.078254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92335826-81de-4c91-b0c9-38438802c37d None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:18.079129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92335826-81de-4c91-b0c9-38438802c37d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:18.080615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92335826-81de-4c91-b0c9-38438802c37d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:18.100739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 447/873] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:17 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:18.265872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87af04f-d8ac-46c2-924f-e112f3ef3a29 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:18.266240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87af04f-d8ac-46c2-924f-e112f3ef3a29 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:18.266445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87af04f-d8ac-46c2-924f-e112f3ef3a29 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:18.268111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 427/874] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:18.273841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:18.274138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:18.274421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:18.291785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:18.292970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:18.367273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 448/875] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:18.397461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87af04f-d8ac-46c2-924f-e112f3ef3a29 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:18.502672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87af04f-d8ac-46c2-924f-e112f3ef3a29 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:18.541432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:18.541801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:18.542083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:18.542356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:18.543011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:18.544691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:18.556656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 13:55:18.558210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 428/876] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:18.564043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:18.660729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9d757-b086-4a3a-bdbd-905eb2053b15 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:18.694938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:18.695612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:18.695891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:18.696164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:18.696869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:18.697179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:18.698569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3102c4-9ec1-447a-947d-f393813e6b44 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:18.703528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 449/877] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:18.709091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:18.812310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f171-9ca5-4c81-9166-7a74e2974fb7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:18.853137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:18.854702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:18.854702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:18.854702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:18.854702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:18.856070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:18.857585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468fccd-c655-4f70-97d4-ddcd5dac32c2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:18.861349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 429/878] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:19.008360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520971f-2940-4afb-af71-6f9ec1433961 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:19.009061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520971f-2940-4afb-af71-6f9ec1433961 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:19.009061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520971f-2940-4afb-af71-6f9ec1433961 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:19.010543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 450/879] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:19.016046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498857-fac9-4f69-9809-c165b3b25c6a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:19.016328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498857-fac9-4f69-9809-c165b3b25c6a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:19.016610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498857-fac9-4f69-9809-c165b3b25c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:19.034834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-97498857-fac9-4f69-9809-c165b3b25c6a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:19.035285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-97498857-fac9-4f69-9809-c165b3b25c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:19.104616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 430/880] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:19.127065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520971f-2940-4afb-af71-6f9ec1433961 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:19.230764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520971f-2940-4afb-af71-6f9ec1433961 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:19.265679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebef2e-3cb6-4b0b-9510-e750dce9b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:19.266269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebef2e-3cb6-4b0b-9510-e750dce9b990 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:19.266550 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebef2e-3cb6-4b0b-9510-e750dce9b990 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:19.266826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebef2e-3cb6-4b0b-9510-e750dce9b990 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:19.267591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebef2e-3cb6-4b0b-9510-e750dce9b990 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:19.269010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebef2e-3cb6-4b0b-9510-e750dce9b990 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:19.288496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 451/881] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:19 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:20.003944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9300d8-fb7a-4f7e-b3ee-89ad3112932e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.004506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9300d8-fb7a-4f7e-b3ee-89ad3112932e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.004506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9300d8-fb7a-4f7e-b3ee-89ad3112932e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.006071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 431/882] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:20.012275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.013279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.013809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.031265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:20.032806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:20.121579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 452/883] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:20.140186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9300d8-fb7a-4f7e-b3ee-89ad3112932e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.244206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9300d8-fb7a-4f7e-b3ee-89ad3112932e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:20.284542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9180c-1cec-46ff-9465-f08c844e94c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:20.285797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9180c-1cec-46ff-9465-f08c844e94c5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.286306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9180c-1cec-46ff-9465-f08c844e94c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.286784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9180c-1cec-46ff-9465-f08c844e94c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.299305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9180c-1cec-46ff-9465-f08c844e94c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:20.307390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f2e9180c-1cec-46ff-9465-f08c844e94c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 13:55:20.313654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 432/884] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:20.315404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.416939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a309-bf63-4ed5-8c1f-0de1d3f978ec None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:20.453385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:20.454084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.454369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.454640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.455379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:20.455681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:20.457088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:20.466411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 453/885] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:20.467491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326727e-b6ec-4396-815c-c3b9afb85d38 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.467990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326727e-b6ec-4396-815c-c3b9afb85d38 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.468506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326727e-b6ec-4396-815c-c3b9afb85d38 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.470574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 433/886] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:20.475468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.477822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.477822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.477822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.494320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:20.495986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:20.578028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 434/887] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:20.606828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8501-f1c0-43eb-8810-a23b5866003d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:20.608135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.645088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:20.646337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.646835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.647302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.658932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:20.660810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:20.678981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:20.685799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 454/888] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:20.686971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.721195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958186a-a36c-4f62-9b70-50618bf1d636 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:20.757299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:20.758475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.758916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.759448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.760316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:20.762019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:20.773751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 28 13:55:20.775742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 435/889] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:20.782679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.803826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f130d6-d62b-4a97-bda8-945b9c217396 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:20.842910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:20.844261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.845177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.847064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.848025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:20.848815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:20.850828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:20.864457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 455/890] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:20.870467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.930966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530b798-1a19-4111-94e3-76be143e3f82 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:20.965133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:20.966268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:20.966759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:20.967234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:20.968153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:20.968669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:20.970257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:20.975781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 436/891] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:20.982082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:20.989872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968115-80d4-4cb0-88ca-ce6ef372ea01 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.026558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.028151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.028612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.029116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.038475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.040322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.056785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 13:55:21.061869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 456/892] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:21.064561 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.110645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a391-8c49-4c33-bd93-a1e5771f6873 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.152129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.152948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.154020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.154306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.155027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:21.155341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.156822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.165708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 437/893] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:21.169887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.197532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964970e-7a55-4000-bd41-b9f5670d9106 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.231583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.233519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.233519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.233519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.233845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:21.234040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.235402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866b04a-deff-4d04-bdab-5736493d0218 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.258942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 457/894] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:21.258942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a87fb-6884-4227-bfbc-650dc271f9b8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.258942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a87fb-6884-4227-bfbc-650dc271f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.258942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a87fb-6884-4227-bfbc-650dc271f9b8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.258942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 458/895] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:21.262294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a87fb-6884-4227-bfbc-650dc271f9b8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.279351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a74f-15d3-49e6-8521-1dda366d3bc2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.314365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.315026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.315308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.315595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.316797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] RBAC: Adding query filter params (interface=public, service_id=882bad3a27b34013b1db0f1b844eb584, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:21.317108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.318982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744c238-8ebb-489c-bae3-c385c4288a24 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.330527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 438/896] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/endpoints?service_id=882bad3a27b34013b1db0f1b844eb584&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:21.330527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.330527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.330527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.346244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:21.347420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:21.362062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a87fb-6884-4227-bfbc-650dc271f9b8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.396188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.397501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.397820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.398097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.413587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 439/897] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:21.414261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.474015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.476278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.515165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3fe44-82a4-4ce9-87c6-06d3dff0adc2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.549272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.549975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.550256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.550529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.551212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.552619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.558541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 440/898] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 13:55:21.559388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.598103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 459/899] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:21.606819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.665444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c186a-f262-48c0-84aa-15cda186a21a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.702076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660bad7-6f6c-4798-ae66-f410ee1f560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.702763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bad7-6f6c-4798-ae66-f410ee1f560b None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.703046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bad7-6f6c-4798-ae66-f410ee1f560b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.703324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bad7-6f6c-4798-ae66-f410ee1f560b None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.704061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660bad7-6f6c-4798-ae66-f410ee1f560b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.705455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660bad7-6f6c-4798-ae66-f410ee1f560b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.720449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 441/900] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:21 2022] POST /identity/v3/services => generated 241 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:21.721865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61f43-1ac0-447b-b503-3a608841e8a9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.722154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61f43-1ac0-447b-b503-3a608841e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.722433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61f43-1ac0-447b-b503-3a608841e8a9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.724077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 442/901] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:21.730698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.731003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.731259 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.742247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dfa27-74fa-4a32-817c-9f181c20ef01 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:21.757072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:21.759200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:21.795172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:21.796007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:21.796289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:21.796560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:21.811771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:21.812934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:21.833520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:21.835208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 460/902] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:21.840858 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.858280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 443/903] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:21.885824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:21.975201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329928d-b6fe-4b06-941d-df58365a978a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.009293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686a9c9-774a-4d2d-8fad-626eb0289543 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.018543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.019211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.019495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.019830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.020611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:22.020925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.022365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.034285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 461/904] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:22.039865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.048039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.048863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.049144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.049420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.050555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.052355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.067724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 28 13:55:22.069427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 444/905] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Apr 28 13:55:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:22.075098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.150847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26946f4-cee9-4bd9-bf8a-a6f0b1304d57 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.174444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510da57-8968-4aa6-bfca-7365d7715402 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.185378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.186456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.186967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.187414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.194462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.196098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.206965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.207625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.207908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.208184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.209428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:22.209779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.211137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.212605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:22.221755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 445/907] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:22.221944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 462/907] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:22.223321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.225164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.324107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5515-be0d-40fb-b36f-fd29b76abb3c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.326774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c86a-cfcf-4571-a691-e8ea0b2f1759 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.358241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.358905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.359187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.359461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.360161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:22.360468 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.361845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.363461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.364335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.364868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.365455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.366461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:22.366965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.368586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.371532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 446/908] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:22.372589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.386467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 463/909] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:22.387593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.472047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a6c2d-d98b-40dd-9f1a-6c8a00d33e6b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.486768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31490926-4288-4aab-897a-9ccef42a3d0a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.506647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.507363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.507649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.507925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.508838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] RBAC: Adding query filter params (interface=public, service_id=705f2031c58f48daa293759f9b480bc8, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:22.509035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.510406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.515917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 447/910] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/endpoints?service_id=705f2031c58f48daa293759f9b480bc8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:22.524763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.525799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.526183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:22.526593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.527088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.528118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] RBAC: Adding query filter params (role.id=9f822a53892b43f9a38353a1bcfbb898, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=c8489bced3994d299e7edc9af7b1326d) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:22.528629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.530317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077844c9-a128-4418-89c2-043f5753bac6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.536490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 464/911] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/role_assignments?user.id=c8489bced3994d299e7edc9af7b1326d&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=9f822a53892b43f9a38353a1bcfbb898 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:22.636258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7c5b3-48be-4d40-8635-3cef4cb7e54f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:22.672888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9983ba4-cd4a-4fe7-b576-3161cce6068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:22.673590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9983ba4-cd4a-4fe7-b576-3161cce6068f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:22.673950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9983ba4-cd4a-4fe7-b576-3161cce6068f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:22.674223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9983ba4-cd4a-4fe7-b576-3161cce6068f None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:22.674915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9983ba4-cd4a-4fe7-b576-3161cce6068f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:22.676291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9983ba4-cd4a-4fe7-b576-3161cce6068f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:22.683474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 448/912] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:22 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 13:55:23.948113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61159e1b-be10-4700-bf09-5bfb369d5808 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:23.948630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61159e1b-be10-4700-bf09-5bfb369d5808 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:23.948735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61159e1b-be10-4700-bf09-5bfb369d5808 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:23.950368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 465/913] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:23.955480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b117b9-780e-4451-832e-79c7cb4750df None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:23.955887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b117b9-780e-4451-832e-79c7cb4750df None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:23.956071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b117b9-780e-4451-832e-79c7cb4750df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:23.973121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-33b117b9-780e-4451-832e-79c7cb4750df None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:23.974970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-33b117b9-780e-4451-832e-79c7cb4750df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:24.040607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 449/914] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:24.063497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61159e1b-be10-4700-bf09-5bfb369d5808 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.107718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ca94-87a4-4a51-a9bf-083ee7a1e666 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.108370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ca94-87a4-4a51-a9bf-083ee7a1e666 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.108866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ca94-87a4-4a51-a9bf-083ee7a1e666 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.111744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 450/915] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:24.117841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.118385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.118886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.135797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:24.137279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:24.184666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61159e1b-be10-4700-bf09-5bfb369d5808 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.216972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 451/916] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:24.225509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.226341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.226625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.226901 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.227559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.228925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.235073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.241655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 28 13:55:24.243237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 466/917] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:24.248462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.353774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a395a3-0500-4cf4-806e-5d1d7343a46d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.372056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfece2f-f7bc-4d27-b361-f1b58a7e2411 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.390138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.391225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.391716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.392168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.393014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.394609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.407265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 13:55:24.409033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 452/918] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:24.414379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.415260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.415394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.415658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.415999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.416801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:24.417113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.418522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.429460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 467/919] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:24.430572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.536058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81139e-09a1-4363-ab9d-3f4bd0a39433 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.553153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864cd8b-6cc3-471c-8b47-0e893c966e93 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.577092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.578494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.579236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.579662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.580697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:24.581472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.583483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.594794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 468/920] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:24.596034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.596408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.596705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.597034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.597312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.598054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:24.598364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.599768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.609670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 453/921] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:24.610695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.714515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1ae2-8f21-4edd-ac9b-81395688c5f0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.727503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf4b8-3a1f-41f1-a78f-8fb67f796a99 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.748438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.749241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.749730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.750043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.750851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:24.751270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.752719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.763434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 454/922] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:24.764416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.769414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0825-fa60-4d1f-8b9f-759370f4fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.770294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0825-fa60-4d1f-8b9f-759370f4fce7 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.770726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0825-fa60-4d1f-8b9f-759370f4fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.771186 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0825-fa60-4d1f-8b9f-759370f4fce7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.772072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a0825-fa60-4d1f-8b9f-759370f4fce7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.773820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a0825-fa60-4d1f-8b9f-759370f4fce7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.814366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 469/923] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:24.842061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc51b-0dd3-4629-ba84-4bf7f31e2ff7 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.842593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc51b-0dd3-4629-ba84-4bf7f31e2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.842873 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc51b-0dd3-4629-ba84-4bf7f31e2ff7 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.844706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 470/924] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:24.851118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97bbf-7974-482a-b6f1-7fbac04bc70c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.851558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97bbf-7974-482a-b6f1-7fbac04bc70c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.851992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97bbf-7974-482a-b6f1-7fbac04bc70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.874747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0de97bbf-7974-482a-b6f1-7fbac04bc70c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:24.876599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0de97bbf-7974-482a-b6f1-7fbac04bc70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:24.883672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24490-5356-4b47-ba68-d02cf45c64ae None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:24.925495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:24.926212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.926497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.926773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.928148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] RBAC: Adding query filter params (interface=public, service_id=abd2d342f5be47d391e8ab97a0c7ff27, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:24.928462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:24.929937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:24.935798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 455/925] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/endpoints?service_id=abd2d342f5be47d391e8ab97a0c7ff27&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:24.941757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:24.968301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 471/926] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:24.991866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a46eb-07e7-4004-9740-3de4e35148b3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:24.992178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a46eb-07e7-4004-9740-3de4e35148b3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:24.992430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a46eb-07e7-4004-9740-3de4e35148b3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:24.994197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 472/927] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:24.995088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a46eb-07e7-4004-9740-3de4e35148b3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.059095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e0b6-2a11-415f-859f-e27adb0fd6d9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.092141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043a7c0-c6e4-4385-86ec-06ef38c4ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.092744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043a7c0-c6e4-4385-86ec-06ef38c4ec18 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.093030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043a7c0-c6e4-4385-86ec-06ef38c4ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.093313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043a7c0-c6e4-4385-86ec-06ef38c4ec18 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.094026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043a7c0-c6e4-4385-86ec-06ef38c4ec18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.095400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043a7c0-c6e4-4385-86ec-06ef38c4ec18 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.109584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 456/928] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 13:55:25.109584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.109584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.109584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.112771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a46eb-07e7-4004-9740-3de4e35148b3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.128586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:25.129850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:25.153889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.154718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.155001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.155276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.168937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:25.177815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 13:55:25.180088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 473/929] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Apr 28 13:55:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:25.189584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.212385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 457/930] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:25.236099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.321232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee33032-dc92-4f07-bf82-fa13ef1b8868 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.352235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0f2c-2883-496e-b5df-871263fb0998 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.364465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.366056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.366841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.367513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.368416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:25.369030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.370866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.387384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 474/931] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:25.388987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.392126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.392946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.393251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.393502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.394214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.395571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.406995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 28 13:55:25.408494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 458/932] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:25.414162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.510032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84837a3-d78f-40ef-a0d6-5cc17d13f9a8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.528516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71bce0-24cf-4ee4-b130-248213d33d7e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.545326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.546435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.546920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.547376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.558882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.560732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.564080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.564704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.565107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.565451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.566263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:25.566639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.568111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.577994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 459/933] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:25.579245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.580475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:25.586549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 475/934] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:25.587947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.687261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe712-231b-49b1-8f56-4ee9437ed282 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.692345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3b01-90d3-44a6-90d5-c1cc6081a5a6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.727176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.728110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.728395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.728667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.729383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:25.729709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.731064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.733451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.734623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.735107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.735599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.736546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:25.737112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.738689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.741067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 460/935] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:25.742999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.759333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 476/936] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:25.761295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:25.848221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baabffa-8609-4d37-a626-e3f57b1c3740 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.862669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce0bcf-8637-40fd-92c8-29e976d0edef None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:25.885578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.885578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.885578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.885578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.897316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.897316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.902131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:25.903057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:25.903359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:25.903686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:25.913894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:25.915823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:25.921760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 461/937] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:25.936797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 13:55:25.943594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 477/938] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:25.945364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:26.069242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54881474-13e6-45f6-9733-dfc35836e089 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:26.105547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:26.106266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:26.106554 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:26.106832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:26.107695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:26.108007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:26.109587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:26.128154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 462/939] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Apr 28 13:55:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:26.133944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:26.238839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703e08-1123-4d36-815f-4c3dfbcf457d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:26.274005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:26.275117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:26.275587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:26.276050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:26.287269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:26.288943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:26.306923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:26.308767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 478/940] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:26.314717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:26.413149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b68cb-9d61-420d-b20f-2c3ec4f1aff2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:26.446838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:26.447794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:26.448424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:26.448894 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:26.449811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:26.450310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:26.451842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:26.463351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 463/941] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:26.469036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:26.568808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35f89-415a-4806-a6d4-33f2f66b41ff None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:26.603217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:26.604359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:26.604830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:26.605299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:26.612242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:26.613909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:26.628395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:26.630285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 479/942] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:26.641579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:26.741716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62488-1a85-4f76-8a8b-06a0b1e6d270 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:26.775898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:26.776569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:26.776855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:26.777131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:26.777954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:26.778267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:26.779747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cc220-ba65-4282-9e3b-735f4253990a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:26.793105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 464/943] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:26.798941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:26.901452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75251-3dbc-45e6-971b-3a67495715cc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:26.935848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b7522-f1ae-4ee0-a4d7-0c99df191091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:26.936970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b7522-f1ae-4ee0-a4d7-0c99df191091 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:26.937420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b7522-f1ae-4ee0-a4d7-0c99df191091 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:26.937883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b7522-f1ae-4ee0-a4d7-0c99df191091 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/c8489bced3994d299e7edc9af7b1326d/roles/9f822a53892b43f9a38353a1bcfbb898` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:26.940282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b7522-f1ae-4ee0-a4d7-0c99df191091 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=c8489bced3994d299e7edc9af7b1326d, role_id=9f822a53892b43f9a38353a1bcfbb898)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:26.941891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b7522-f1ae-4ee0-a4d7-0c99df191091 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:26.957945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 480/944] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:26 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/c8489bced3994d299e7edc9af7b1326d/roles/9f822a53892b43f9a38353a1bcfbb898 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:55:27.209939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deab595-3fa7-4929-ac67-9b08a41d53c0 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.210454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deab595-3fa7-4929-ac67-9b08a41d53c0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.210454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deab595-3fa7-4929-ac67-9b08a41d53c0 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.211994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 465/945] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:27.217236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.217782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.217983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.237015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:27.238214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:27.308384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 481/946] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:27.332007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deab595-3fa7-4929-ac67-9b08a41d53c0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:27.432906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deab595-3fa7-4929-ac67-9b08a41d53c0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:27.467438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:27.468050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.468387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.468670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.469400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:27.470888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:27.472308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.common [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 28 13:55:27.491634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.sql.core [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 28 13:55:27.491634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 28 13:55:27.491634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [parameters: {'id': 'f343fca16a7c4ad485288cf2efa2b868', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 28 13:55:27.491634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79785) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 28 13:55:27.498411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-38f5169c-bed6-468e-8a1e-453687a90109 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f343fca16a7c4ad485288cf2efa2b868.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f343fca16a7c4ad485288cf2efa2b868. Apr 28 13:55:27.500132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 466/947] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Apr 28 13:55:27 2022] POST /identity/v3/projects => generated 262 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:27.505850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:27.524572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a90fd7-714d-46d6-934c-2b533110c18e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.525119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a90fd7-714d-46d6-934c-2b533110c18e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.525600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a90fd7-714d-46d6-934c-2b533110c18e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.530480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 467/948] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:27.535190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.535481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.535765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.553814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:27.555309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:27.625066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a20918-2efd-4ce3-a5d0-51ea7121554c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:27.637635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 468/949] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:27.653667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:27.663521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:27.664746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.665035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.665660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.674999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:27.676738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:27.693520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:27.695823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 482/950] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:27.701289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:27.758853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a78db-71c8-48df-bcc0-a4730504e523 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:27.793492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:27.794720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.795005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.795278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.795934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:27.797429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:27.807962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159425-ff70-4647-a381-4a4c9f5a0cb0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:27.809232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 13:55:27.810503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 469/951] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:27.816597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:27.846685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:27.847682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.848207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.848703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.849722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:27.850245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:27.851881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:27.869483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 483/952] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:27.939103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec568ce-cb43-4a21-9a3d-215c46e9d1ee None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:27.975975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:27.977091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:27.977689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:27.978174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:27.979131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:27.979659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:27.981267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:27.992020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 470/953] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:27.993825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:28.107405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb4b48-57ab-4c9a-ae4d-024d8defb2cc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:28.141870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:28.142576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.142841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.143112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.143851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:28.144161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:28.145667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a322-238f-47b5-80d5-68bd3881eeaa None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:28.152058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 484/954] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:28.158534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:28.262999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02624781-dd19-45a2-b33a-ca16614a9549 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:28.296515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c34dd-fc70-4f3f-9db3-f1e09ede0fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:28.297175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c34dd-fc70-4f3f-9db3-f1e09ede0fda None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.297455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c34dd-fc70-4f3f-9db3-f1e09ede0fda None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.297768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c34dd-fc70-4f3f-9db3-f1e09ede0fda None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.298509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c34dd-fc70-4f3f-9db3-f1e09ede0fda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:28.299868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c34dd-fc70-4f3f-9db3-f1e09ede0fda None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:28.321507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 471/955] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:28.358291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2b0b-be53-4c31-a8e7-77e18461b7a2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.358810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2b0b-be53-4c31-a8e7-77e18461b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.358810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2b0b-be53-4c31-a8e7-77e18461b7a2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.360352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 485/956] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:28.366821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.367109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.367390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.386944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:28.388176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:28.469873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 472/957] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:28.496709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2b0b-be53-4c31-a8e7-77e18461b7a2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:28.600391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2b0b-be53-4c31-a8e7-77e18461b7a2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:28.633959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071126-b063-4004-a994-e69f460504b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:28.634814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071126-b063-4004-a994-e69f460504b7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.635094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071126-b063-4004-a994-e69f460504b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.635371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071126-b063-4004-a994-e69f460504b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.636060 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33071126-b063-4004-a994-e69f460504b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:28.637427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33071126-b063-4004-a994-e69f460504b7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:28.648656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-33071126-b063-4004-a994-e69f460504b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 28 13:55:28.650178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 486/958] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:28.656223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:28.757583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb51b94-920d-441e-93c1-710b457a61a0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:28.795998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:28.796668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.796958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.797231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.797968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] RBAC: Adding query filter params (name=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:28.798271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:28.799635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943701-9ce1-404b-b03d-28a6cf2f0dba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:28.805347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 473/959] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:28.811085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071126-b063-4004-a994-e69f460504b7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:28.908829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071126-b063-4004-a994-e69f460504b7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:28.943589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:28.944247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:28.944530 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:28.944808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:28.945506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:28.945838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:28.947188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aa743-f3ca-46d1-ac35-c24b36f71db1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:28.951854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 487/960] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:29.314266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493cbb-388b-4134-a04a-0e1858cb0877 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:29.314881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493cbb-388b-4134-a04a-0e1858cb0877 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:29.314881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493cbb-388b-4134-a04a-0e1858cb0877 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:29.316373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 474/961] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:29.322047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:29.322580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:29.323081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:29.341548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:29.343062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:29.409199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 488/962] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:29.432302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b493cbb-388b-4134-a04a-0e1858cb0877 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:29.535018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b493cbb-388b-4134-a04a-0e1858cb0877 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:29.572129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:29.573302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:29.573811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:29.574308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:29.585835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:29.593572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 13:55:29.595276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 475/963] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Apr 28 13:55:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:29.601236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:29.700795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263574a-7529-42ff-8725-62f41b1126b8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:29.734002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:29.735018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:29.735499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:29.735981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:29.736947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:29.737446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:29.739030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:29.748105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 489/964] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:55:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:29.753905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:29.863335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c1ff-4ddf-40e4-bb80-304bab3f218f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:29.898147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:29.899296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:29.899804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:29.900276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:29.910975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:29.912672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:29.930418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:29.932305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 476/965] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:29.938191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.035877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f27012-f552-4454-8b90-568611f41b86 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.074053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.074743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.075033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.075314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.076053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:30.076367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.077820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b171fe-3d6e-4ddd-962a-9d3932cb7709 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:30.095588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 490/966] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:30.108076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.211789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fad48-99fc-4442-b3d8-e28435ca6a5b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.246151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.247330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.247812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.248310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.256368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.258229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:30.272127 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 13:55:30.273896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 477/967] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:55:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:30.277601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94f2db-6d90-4a77-8b3c-e6ab569572d2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.277601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94f2db-6d90-4a77-8b3c-e6ab569572d2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.277601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94f2db-6d90-4a77-8b3c-e6ab569572d2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.277896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 491/968] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:30.280167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.282616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.282901 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.283178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.300037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:30.301193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:30.385923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff01d4-59c8-4e1f-af12-baa23c965330 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.387016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 492/969] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:30.412088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.426957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.428289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.428772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.429419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.430779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:30.431298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.433372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:30.456278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 478/970] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Apr 28 13:55:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:30.463004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.533767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b800e60-917c-4299-bf29-ad150ea1a7c9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.564693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00d31-5b2d-4105-8bdc-492bfff12c0a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.581185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.581919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.582205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.582481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.583206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.584719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:30.586147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.common [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 28 13:55:30.601066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.sql.core [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 28 13:55:30.601066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 28 13:55:30.601066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [parameters: {'user_id': 'd6d161f420f74a0b920b7a3776ce1402', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 28 13:55:30.601066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79786) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 28 13:55:30.612072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8584b-4fa4-4b18-a770-813c13825281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.613158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8584b-4fa4-4b18-a770-813c13825281 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.613740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8584b-4fa4-4b18-a770-813c13825281 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.614234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8584b-4fa4-4b18-a770-813c13825281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.618803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 28 13:55:30.621659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 493/971] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Apr 28 13:55:30 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:30.627618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.696433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8584b-4fa4-4b18-a770-813c13825281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.698332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8584b-4fa4-4b18-a770-813c13825281 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:30.740632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c378b6-5e93-4d18-91a9-8f4ab3de1689 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.781970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.783133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.783641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.784126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.792529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.794689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:30.808562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-abc978da-c62c-4bfb-bca2-aeb4d99e180d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 13:55:30.810260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 494/972] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:30.811693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e7e4-07f0-4de7-8753-a8b360184439 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.811973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e7e4-07f0-4de7-8753-a8b360184439 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.812246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e7e4-07f0-4de7-8753-a8b360184439 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.816675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 495/973] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:30.817397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e7e4-07f0-4de7-8753-a8b360184439 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.818544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 479/974] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:30 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:30.821718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.822153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.822428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.838074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:30.839234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:30.909854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 480/975] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:30.909854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:30.930215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e7e4-07f0-4de7-8753-a8b360184439 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:30.968612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:30.969278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:30.969572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:30.969999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:30.970643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:30.970945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:30.972351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.014001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 496/976] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Apr 28 13:55:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:31.014263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75e4f-1c92-4b0d-8ee7-0fc67e8f0f76 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.014357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.054302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.055498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.055780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.056107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.071019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.073423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.095064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:31.096788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 481/977] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:31.102726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.158673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500e9c-70bf-457a-b57f-078e7009ba26 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.206119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.206941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.207227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.207511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.208171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.210146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.214067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d640838-88b0-4c9c-8404-0ebdbbacc3d8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.225291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 13:55:31.227597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 497/978] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:31.233239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.254901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.256155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.256436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.256708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.257443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:31.257769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.259134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7f89-4b73-4915-984a-c2e3924b269a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.271629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 482/979] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:31.272827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f428-5a5b-4d05-a9df-c899d1c5371e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.273003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f428-5a5b-4d05-a9df-c899d1c5371e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.273276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f428-5a5b-4d05-a9df-c899d1c5371e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.274553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 483/980] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:31.279659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632f428-5a5b-4d05-a9df-c899d1c5371e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.340707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dba71-c317-40ca-934a-5e55912d137b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.371416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.372067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.372351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.372619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.373306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:31.373626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.374971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0dcbe-61c5-437a-b6f3-44ed35bb1224 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.383641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 498/981] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:31.383641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.383641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.383641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.385492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632f428-5a5b-4d05-a9df-c899d1c5371e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.397732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:31.399252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:31.416690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.417478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.417779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.418048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.424609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.426058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.439489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:31.446024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 484/982] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:31.446024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.461208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 499/983] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:31.462066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.537168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811dd28-ccc7-4055-a0de-68a2860097a9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.555772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603374e9-ce6d-4f25-ac5c-ad1952094720 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.568930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.569605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.569883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.570150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.570837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:31.571138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.572481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.577002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 485/984] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:31.577821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.587758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.588410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.588690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.588958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.589762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:31.590066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.591467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.603241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 500/985] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:31.603936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.679393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bced3-26d8-4aa5-84d5-217e8a27b64c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.696147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc404-a2c4-42dc-9ec9-436bfb3a3a58 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.710456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.711112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.711390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.711658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.712361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.713738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.726303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 486/986] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:31 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:31.727083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.734724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.735403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.735715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.735991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.736809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] RBAC: Adding query filter params (interface=admin, service_id=abd2d342f5be47d391e8ab97a0c7ff27, region_id=RegionOne) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:31.737126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.738557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.747526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 501/987] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/endpoints?service_id=abd2d342f5be47d391e8ab97a0c7ff27&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:31.755971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:31.843179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cecb9-15f4-49d8-894d-67adb83cb3e2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.861719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629eb1e-008e-46ea-a33b-11cfe6de956e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:31.878572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.879875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.880403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.881007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.882738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] RBAC: Adding query filter params (role.id=9f822a53892b43f9a38353a1bcfbb898, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=c8489bced3994d299e7edc9af7b1326d) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:31.883234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.884908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0ce70-0ce8-44ca-a432-e64f15ed6010 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.901585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 487/988] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/role_assignments?user.id=c8489bced3994d299e7edc9af7b1326d&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=9f822a53892b43f9a38353a1bcfbb898 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:31.901803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ab63e-cc6d-4f1f-bb7e-65f4b57ce1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:31.901803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ab63e-cc6d-4f1f-bb7e-65f4b57ce1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:31.901803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ab63e-cc6d-4f1f-bb7e-65f4b57ce1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:31.901803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ab63e-cc6d-4f1f-bb7e-65f4b57ce1c2 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:31.902201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ab63e-cc6d-4f1f-bb7e-65f4b57ce1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:31.902201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ab63e-cc6d-4f1f-bb7e-65f4b57ce1c2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:31.907277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 502/989] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:31 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 13:55:34.026221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f9b6-494e-42a2-b1e0-cc1c9bb8ccb1 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.026760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f9b6-494e-42a2-b1e0-cc1c9bb8ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.026760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f9b6-494e-42a2-b1e0-cc1c9bb8ccb1 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.028308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 488/990] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:34.033679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff00f-4859-46fc-aade-70db129e30af None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.034173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff00f-4859-46fc-aade-70db129e30af None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.034254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff00f-4859-46fc-aade-70db129e30af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.051440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c47ff00f-4859-46fc-aade-70db129e30af None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:34.053231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c47ff00f-4859-46fc-aade-70db129e30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:34.119339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 503/991] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:34.141435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641f9b6-494e-42a2-b1e0-cc1c9bb8ccb1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.192787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50916490-cf74-4b2c-8d3e-d1659b84b6e9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.193069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50916490-cf74-4b2c-8d3e-d1659b84b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.193340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50916490-cf74-4b2c-8d3e-d1659b84b6e9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.194896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 504/992] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:34.195797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16c5fb-7ac1-4f7f-a87a-12936fad7a60 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.196078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16c5fb-7ac1-4f7f-a87a-12936fad7a60 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.196349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16c5fb-7ac1-4f7f-a87a-12936fad7a60 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.197607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 505/993] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:34.199800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857027-1be2-4a43-8c6a-b7265b1c72aa None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.200079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857027-1be2-4a43-8c6a-b7265b1c72aa None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.200355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857027-1be2-4a43-8c6a-b7265b1c72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.217163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-74857027-1be2-4a43-8c6a-b7265b1c72aa None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:34.218383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-74857027-1be2-4a43-8c6a-b7265b1c72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:34.242401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641f9b6-494e-42a2-b1e0-cc1c9bb8ccb1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.273323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.274133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.274413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.274685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.275326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.276718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.281119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 506/994] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:34.282394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.282682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.282954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.287940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 28 13:55:34.294140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 489/995] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:34.295114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.305040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:34.306648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:34.370744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 507/996] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:34.371576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.390688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919c81-d672-4138-a4ca-666e5a78d947 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.421674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.422326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.422603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.422872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.423558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.423857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.425197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.430383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 490/997] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:34.431136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.465065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8170e-be63-423f-8cd1-c403888792dd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.496141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.496927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.497494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.497799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.498442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.499781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.511160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 13:55:34.512320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 508/998] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:34.513073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.524551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00442ec4-f369-40eb-9b75-939dce076895 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.556576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.557281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.557585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.557858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] PATH_INFO: `/v3/services/image` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.558497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.559834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.570169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 28 13:55:34.571319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 491/999] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services/image => generated 86 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:34.572067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.604527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd8f8a-a625-4c80-8cbb-53eefc5eed03 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.638337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.639001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.639284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.639586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.640289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.640596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.641989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.646672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 509/1000] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:34.647522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.674030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28297f-086c-4009-a1f4-10c687dc1596 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.705260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.705942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.706224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.706499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.707193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.707499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.708847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.713406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 492/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:34.714436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.741720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a3d1-8f31-4342-9af9-25db67786506 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.771882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.772524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.772801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.773073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.773794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] RBAC: Adding query filter params (name=image) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.774094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.775435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.780254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 510/1002] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:34.781009 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.809624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976a47-75fe-487c-9eb8-b5649411f228 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.840820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.841582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.841876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.842150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.842919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] RBAC: Adding query filter params (interface=public, service_id=054be715d4b545719c470112d713f884, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.843226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.844599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.849920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 493/1003] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/endpoints?service_id=054be715d4b545719c470112d713f884&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:34.850680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.878125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cedc5-71c0-41b1-af6a-8435fa86e676 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.909188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.909866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.910150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.910424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.911112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.912103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.913770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.918355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 511/1004] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:34.919376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:34.947273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625241-38cf-4a20-80d9-90c3d020d484 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:34.980989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:34.981684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:34.981970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:34.982249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:34.982946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] RBAC: Adding query filter params (type=image) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:34.983479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:34.984613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:34.988900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 494/1005] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:34.989716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:35.018208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e69fba-896c-4f88-8095-5f3ae601f74b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:35.055306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc50027-194a-4d2f-bd6d-2ce2a0df21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:35.056007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50027-194a-4d2f-bd6d-2ce2a0df21d7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:35.056262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50027-194a-4d2f-bd6d-2ce2a0df21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:35.056539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50027-194a-4d2f-bd6d-2ce2a0df21d7 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:35.057235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc50027-194a-4d2f-bd6d-2ce2a0df21d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:35.058665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc50027-194a-4d2f-bd6d-2ce2a0df21d7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:35.065376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 512/1006] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:34 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 13:55:35.102799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e42e4-02a0-44f2-a28a-cf8498ac0bf3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:35.144427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357e2c-4dc0-4659-ab16-872dba5001c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:35.145116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357e2c-4dc0-4659-ab16-872dba5001c8 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:35.145402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357e2c-4dc0-4659-ab16-872dba5001c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:35.146270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357e2c-4dc0-4659-ab16-872dba5001c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:35.147135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357e2c-4dc0-4659-ab16-872dba5001c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:35.148594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357e2c-4dc0-4659-ab16-872dba5001c8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:35.173663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 495/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:37.259323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26358ffb-9331-4ad5-b7b7-96a7e9623466 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.259835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26358ffb-9331-4ad5-b7b7-96a7e9623466 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.259914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26358ffb-9331-4ad5-b7b7-96a7e9623466 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.261234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 513/1008] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:37.266642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.267055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.267246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.284564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:37.285789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:37.342244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eded80-0b17-440b-8046-0e8052ab393e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.342532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eded80-0b17-440b-8046-0e8052ab393e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.342982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eded80-0b17-440b-8046-0e8052ab393e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.344507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 514/1009] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:37.350278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529c3b9-8073-47eb-a9de-b96af1b82d32 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.350731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529c3b9-8073-47eb-a9de-b96af1b82d32 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.351160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529c3b9-8073-47eb-a9de-b96af1b82d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.364651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 496/1010] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:37.368275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a529c3b9-8073-47eb-a9de-b96af1b82d32 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:37.369748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a529c3b9-8073-47eb-a9de-b96af1b82d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:37.388327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:37.435164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 515/1011] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:37.436487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef35ac-618c-46b8-a5a1-2b6f0ee18c5c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.436843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef35ac-618c-46b8-a5a1-2b6f0ee18c5c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.437050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef35ac-618c-46b8-a5a1-2b6f0ee18c5c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.438473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 516/1012] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:37.443407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.443697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.443979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.462546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:37.463738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:37.488796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e01e7-04b2-41cc-b4f7-77ef3bc3c05e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:37.521393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:37.522270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.522552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.522825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.523543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:37.524908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:37.526452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 517/1013] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:37.527282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:37.541592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 497/1014] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:37 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:55:37.550971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:37.645443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd289fb-b400-42ba-91b7-5158edeaad23 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:37.666905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99df1b-b471-4a96-8424-e4b698183357 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:37.681693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:37.681693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.682587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.682662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.683292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:37.684823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:37.697232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 28 13:55:37.703403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 518/1015] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:37.705145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:37.706664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:37.707488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.707771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.708616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.709875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:37.711343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:37.717891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 498/1016] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:37.719823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:37.804651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867833-8195-4238-b78c-55fe0824579b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:37.819634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d457-be59-4358-b6b2-e8d3569fed69 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:37.837335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:37.838096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.838376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.838651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.839353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:37.839656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:37.841085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:37.850478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 519/1017] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:37.851526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:37.854390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:37.855057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.855341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.855617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.856322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:37.857781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:37.885081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 499/1018] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:55:37 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:37.954724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0bcc-4a11-4cb8-8b6c-d5f694fcd758 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:37.989632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:37.990466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:37.990750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:37.991019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:37.991728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:37.992031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:37.993403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc12fa-6670-460b-9860-bea0daa976dc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:38.003733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 520/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Apr 28 13:55:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:38.004849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:38.104183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea5db-ebdc-49f1-95b5-2ec99f3011bc None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:38.138391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc251c4-441c-4d66-8064-c9f5ebb75d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:38.139046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc251c4-441c-4d66-8064-c9f5ebb75d2f None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:38.139331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc251c4-441c-4d66-8064-c9f5ebb75d2f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:38.139603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc251c4-441c-4d66-8064-c9f5ebb75d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:38.140336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc251c4-441c-4d66-8064-c9f5ebb75d2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:38.141724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc251c4-441c-4d66-8064-c9f5ebb75d2f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:38.165100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 500/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:55:39.837846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495840c-6584-4e1b-91ba-4d49100a719d None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:39.838405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495840c-6584-4e1b-91ba-4d49100a719d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:39.838405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495840c-6584-4e1b-91ba-4d49100a719d None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:39.839769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 521/1021] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:39.845500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:39.845964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:39.846089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:39.864676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:39.865921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:39.937977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 501/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:39.960828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495840c-6584-4e1b-91ba-4d49100a719d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.059367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495840c-6584-4e1b-91ba-4d49100a719d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.105644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.106460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.106737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.107026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] PATH_INFO: `/v3/services/image` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.107664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.109048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.122036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-082ba9ba-6795-453b-926c-e742cb6a6502 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 28 13:55:40.123489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 522/1023] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Apr 28 13:55:39 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:40.129164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.226501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34aa5b-423e-4506-840e-55e3c863d256 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.260096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.260767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.261046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.261321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.262067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:40.262373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.263736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.273199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 502/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:40.273368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76d80-ffc8-4852-86a1-a7456726e8ac None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.273368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76d80-ffc8-4852-86a1-a7456726e8ac None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.273368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76d80-ffc8-4852-86a1-a7456726e8ac None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.273368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 523/1025] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:40.275214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.275617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.275965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.276183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.292719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:40.294195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:40.362241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 524/1026] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:40.381408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28abd4c-a0bb-4a46-ba63-239a614ce3e9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.388107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.414951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.415861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.416134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.416409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.417111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] RBAC: Adding query filter params (type=image) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:40.417420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.419145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.425725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 503/1027] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:40.430688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.483578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a7c3-aea3-408e-b9ec-dbd68ccb23a8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.517978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517992d9-f66f-4e7e-8b0b-81e0fd86428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.518777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517992d9-f66f-4e7e-8b0b-81e0fd86428c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.519059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517992d9-f66f-4e7e-8b0b-81e0fd86428c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.519330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517992d9-f66f-4e7e-8b0b-81e0fd86428c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.520533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517992d9-f66f-4e7e-8b0b-81e0fd86428c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.521997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517992d9-f66f-4e7e-8b0b-81e0fd86428c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.523787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 525/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:40.524945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85f60-e751-4078-acba-61536dfb80f1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.525232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85f60-e751-4078-acba-61536dfb80f1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.525511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85f60-e751-4078-acba-61536dfb80f1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.526796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 526/1029] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:40.527665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbbf8-95ab-4478-bb2e-9b3b210558ba None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.529387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85f60-e751-4078-acba-61536dfb80f1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.560710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.561363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.561684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.561965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.562743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] RBAC: Adding query filter params (interface=public, service_id=85f659ca24434eda8a477b4ca35ac001, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:40.563056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.564402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520532-2c8b-43ae-9b01-4fa43ea97b04 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.569191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 504/1030] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/endpoints?service_id=85f659ca24434eda8a477b4ca35ac001&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:40.570376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972807-df08-4815-8c03-67b685bf173f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.570664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972807-df08-4815-8c03-67b685bf173f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.570949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972807-df08-4815-8c03-67b685bf173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.586617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f1972807-df08-4815-8c03-67b685bf173f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:40.587786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f1972807-df08-4815-8c03-67b685bf173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:40.624821 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85f60-e751-4078-acba-61536dfb80f1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.650243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 505/1031] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:40.651057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972807-df08-4815-8c03-67b685bf173f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.655928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.656585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.656867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.657140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.657870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.659288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.685774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 527/1032] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:55:40 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:55:40.685774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.763463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972807-df08-4815-8c03-67b685bf173f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.787370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4124471-ff03-45c3-aa25-284ed1bc30ad None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:40.800015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.800697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.800980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.801265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.802583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:40.803988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:40.810885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 506/1033] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 13:55:40.835076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:40.835990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:40.836272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:40.836544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:40.849225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:40.856855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 13:55:40.858361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 528/1034] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:40.864887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:40.972751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a4023-957b-44a2-a0be-083b607955c7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:41.008960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:41.009728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:41.010014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:41.010315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:41.011062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:41.011371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:41.012745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:41.021618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 507/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:55:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:41.027579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:41.123301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119c71-082a-4d39-b147-4359e1a0815c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:41.155039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:41.155826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:41.156102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:41.156374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:41.167288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:41.168991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:41.184818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:41.186235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 529/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:41.191621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:41.284888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757df44-46d9-41be-b237-8ef07f576ebf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:41.315581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:41.316234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:41.316511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:41.316783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:41.318046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:41.318349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:41.319689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:41.330932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 508/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:41.336883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:41.429882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb714a10-ef46-4fa3-a794-1f73c34112e3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:41.461917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:41.462711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:41.462998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:41.463276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:41.470638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:41.472437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:41.485428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:55:41.491295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 530/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:55:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:41.492750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:41.589166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5e034-cc70-4ba6-8a62-8e486b147917 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:41.622040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:41.622725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:41.622725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:41.622725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:41.622725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:41.622725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:41.625842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:41.647792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 509/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:55:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:41.649040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:41.745144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183c03-5cb5-44c0-b912-b1109182192c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:41.777151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:41.777820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:41.778108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:41.778385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:41.842744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:41.844112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:41.939628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 531/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:41.946153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:42.040710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30e539-5767-4b61-a219-710b47b87269 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:42.072601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:42.073389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:42.073702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:42.073995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:42.083469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:42.084907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:42.102280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:42.108015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 510/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:42.110990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:42.206105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f00756-06f9-441c-8648-1c45e2184fa8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:42.239743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:42.240402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:42.240685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:42.240959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:42.241701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:42.242012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:42.243371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:42.257597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 532/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:42.261792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:42.356595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9c6ff-20d3-4fc9-8526-1afd3db3b3c4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:42.389389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:42.390211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:42.390493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:42.390764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:42.397794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:42.399230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:42.412372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:42.420128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 511/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:42.420258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:42.513394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24169-27b7-4a04-817e-9f3715fffc58 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:42.546115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:42.547018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:42.547451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:42.547864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:42.548778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:42.549226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:42.550882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4439-f462-4d8e-90ed-84dd40f9147c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:42.567637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 533/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:42.568892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:42.665376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa676-2ddd-49ac-98b1-a6465d717f27 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:42.697084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:42.697765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:42.698050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:42.698326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:42.699148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] RBAC: Adding query filter params (role.id=9f822a53892b43f9a38353a1bcfbb898, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=be883e9492f14daa856a2a9eba500bb4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:42.699459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:42.700886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932ae7-0534-42bc-bdfe-50041b24e768 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:42.713831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 512/1045] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:42 2022] GET /identity/v3/role_assignments?user.id=be883e9492f14daa856a2a9eba500bb4&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=9f822a53892b43f9a38353a1bcfbb898 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:43.014065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873544d-73ab-48a1-8412-401bbe923d02 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.014565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873544d-73ab-48a1-8412-401bbe923d02 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.014565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873544d-73ab-48a1-8412-401bbe923d02 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.016056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 534/1046] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:43.023410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.023818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.023983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.040421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:43.041634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:43.080929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3834b-a2ec-4d21-82cb-7302560e7e01 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.081229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3834b-a2ec-4d21-82cb-7302560e7e01 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.081481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3834b-a2ec-4d21-82cb-7302560e7e01 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.083680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 535/1047] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:55:43.088262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.088550 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.088828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.107108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 513/1048] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:43.109329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:43.110617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:43.130543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.177592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 536/1049] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:43.199660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.223553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e50c-7ade-40d7-9ae6-ede2668edec0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.259157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.259957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.260222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.260492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.272057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:43.278820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:43.280492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 514/1050] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:43.286126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.295546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7b74d-fe6c-4502-8b4d-6d39ee5ae560 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.328841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.329652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.329934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.330208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] PATH_INFO: `/v3/services/image` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.330862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.332234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.342985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 28 13:55:43.345590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 537/1051] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:43.349943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.384236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8570-cb7e-4802-ab49-c6b955ef3903 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.416087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.416804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.417085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.417358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.418138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:43.418712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.420065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.428482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 515/1052] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:43.434049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.446488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587aae6-87ec-4eb4-95fe-1f44b6d6e28d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.479170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.479832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.480110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.480381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.481079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] RBAC: Adding query filter params (name=image) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:43.481380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.482775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.487473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 538/1053] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:43.493503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.535324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e825b9-feda-44d2-a1e2-466e67055f1a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.576210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.577088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.577368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.577669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] PATH_INFO: `/v3/users/8a1a3747cf6541cb92d1f6daad205e42` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.591106 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] RBAC: Authorizing `identity:get_user(user_id=8a1a3747cf6541cb92d1f6daad205e42)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.592555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.593839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e5a72-b92d-4c4d-a1bf-71c54464cf34 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.594433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 516/1054] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/users/8a1a3747cf6541cb92d1f6daad205e42 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:43.600294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.633916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.634584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.634865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.635139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.635837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] RBAC: Adding query filter params (type=image) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:43.636139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.637488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.644036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 539/1055] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:43.649068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:43.699508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4504e-bc47-4ede-bf51-48b6cb435899 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.733189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.733900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.734175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.734446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.748243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516a7c-14d9-4f5a-8646-36e7c1eecc48 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:43.780612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:43.781268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:43.781564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:43.781853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:43.782589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.783948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.799873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:43.801247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:43.805271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 540/1056] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:55:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:55:43.908244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 517/1057] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 13:55:43.914885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:44.021698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733343-e454-435d-af97-9e6c7dbfe069 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:44.054063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7f7d1-b726-4a58-b09d-4c73307b74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:44.054842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7f7d1-b726-4a58-b09d-4c73307b74ee None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:44.055118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7f7d1-b726-4a58-b09d-4c73307b74ee None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:44.055386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7f7d1-b726-4a58-b09d-4c73307b74ee None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:44.056542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7f7d1-b726-4a58-b09d-4c73307b74ee None admin] RBAC: Authorizing `identity:get_project(project_id=48921014d62f4fae927d37630394de00)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:44.057998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7f7d1-b726-4a58-b09d-4c73307b74ee None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:44.064629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 541/1058] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:55:43 2022] GET /identity/v3/projects/48921014d62f4fae927d37630394de00 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:44.066158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:44.160022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e8c2d-df45-491c-9395-6710b60ea40b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:44.192761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:44.193417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:44.193725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:44.193999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:44.194822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=48921014d62f4fae927d37630394de00, user.id=8a1a3747cf6541cb92d1f6daad205e42) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:44.195133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:44.196548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc27c-5a5c-4d89-b24b-c73cfe9bc09f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:44.205649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 518/1059] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:44 2022] GET /identity/v3/role_assignments?user.id=8a1a3747cf6541cb92d1f6daad205e42&scope.project.id=48921014d62f4fae927d37630394de00&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:44.965294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd394-67d4-4e21-a9c3-16a8d9daeca9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:44.965600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd394-67d4-4e21-a9c3-16a8d9daeca9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:44.965885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd394-67d4-4e21-a9c3-16a8d9daeca9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:44.967291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 542/1060] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:44.972877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:44.973203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:44.973482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:44.990477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:44.991651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:45.055295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 519/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:45.077749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfd394-67d4-4e21-a9c3-16a8d9daeca9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:45.174235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfd394-67d4-4e21-a9c3-16a8d9daeca9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:45.205885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:45.206689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:45.206971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:45.207246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:45.218334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:45.226240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 13:55:45.227621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 543/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Apr 28 13:55:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:45.233409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:45.328649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddee25-e2b3-4a7a-9950-353e3103ea19 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:45.360967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:45.361668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:45.361952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:45.362225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:45.362964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:45.363268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:45.365197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:45.373007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 520/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:55:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:45.378592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:45.475677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800238-4e45-4511-9402-fe2a1b54014c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:45.507231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:45.508015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:45.508294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:45.508565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:45.518222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:45.519647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:45.537155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:45.538558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 544/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:45.544295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:45.638113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4b51-7251-4679-92d5-853fff433190 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:45.671040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:45.671711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:45.671998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:45.672275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:45.672993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:45.673298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:45.674694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:45.690543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 521/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:45.691857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:45.791597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11fe8-5dd4-4c59-ad33-961f6a458e91 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:45.823652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:45.824441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:45.824718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:45.825036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:45.832441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:45.834513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:45.847737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:55:45.849099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 545/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:55:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:45.854734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:45.955000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d42f-ff2a-497b-8f7f-901d704e9f1a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:45.987499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:45.988174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:45.988457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:45.988760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:45.989622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:45.989936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:45.991384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23ded-8d01-4499-b8df-859b43ddd755 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.008915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 522/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:55:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:46.014325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.095050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1acbe2-2521-4426-a072-795bcbb3202b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.095601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1acbe2-2521-4426-a072-795bcbb3202b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.096066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1acbe2-2521-4426-a072-795bcbb3202b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.097909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 523/1068] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:46.103415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.103890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.104317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.113560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16aa3-3da8-4ac9-85d9-1fc2d056c90b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.121079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:46.122262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:46.146726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.147548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.147836 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.148110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.158505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.160201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.178017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:46.179496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 546/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:46.184871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.187948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 524/1070] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:46.209861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.283211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d658-a677-4c86-b358-ac87f532657d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.308306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4345f5-c730-4f19-95e7-2548ff10d388 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.316248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.317468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.317798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.318117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.318851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:46.319159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.320550 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.333405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 547/1071] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:46.338723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.342035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8d790-7109-4323-9c19-c0bbcd9b0e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.342689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d790-7109-4323-9c19-c0bbcd9b0e4e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.342969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d790-7109-4323-9c19-c0bbcd9b0e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.343232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d790-7109-4323-9c19-c0bbcd9b0e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.407568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8d790-7109-4323-9c19-c0bbcd9b0e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.409319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8d790-7109-4323-9c19-c0bbcd9b0e4e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.432537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182d47-ad00-4434-b4d1-6f9c82a46940 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.464265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.465053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.465330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.465633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.471995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.473444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.486063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0371dd9e-3343-4796-9355-8510b95ca476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:46.487246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 548/1072] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:46.487246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e67fb-edf7-4ac6-8e3c-fc20c2d734a5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.487246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e67fb-edf7-4ac6-8e3c-fc20c2d734a5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.487246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e67fb-edf7-4ac6-8e3c-fc20c2d734a5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.487246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 549/1073] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:46.493469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e67fb-edf7-4ac6-8e3c-fc20c2d734a5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.514326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 525/1074] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 13:55:46.514326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964a477-eb83-412f-834a-feb691cf963d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.514326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964a477-eb83-412f-834a-feb691cf963d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.514326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964a477-eb83-412f-834a-feb691cf963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.526261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a964a477-eb83-412f-834a-feb691cf963d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:46.527467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a964a477-eb83-412f-834a-feb691cf963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:46.590176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 526/1075] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:46.590994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964a477-eb83-412f-834a-feb691cf963d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.591973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e67fb-edf7-4ac6-8e3c-fc20c2d734a5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.625249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.625931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.626211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.626481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.627249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:46.627551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.628962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.640225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 550/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:46.640993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.685094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964a477-eb83-412f-834a-feb691cf963d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.715830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.716617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.716901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.717175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.727600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.729030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.730688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bd5be-b2fb-4074-9a23-9ab593b5bd8d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.745264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:46.746489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 527/1077] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:46.747230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.762672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.763449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.763725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.763992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.773492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:46.780266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:46.781444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 551/1078] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:46.782211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.840320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9c304-0c6a-446d-9f65-1da67a939f3b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.872488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.873362 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.873680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.873960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/be883e9492f14daa856a2a9eba500bb4/roles/9f822a53892b43f9a38353a1bcfbb898` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.874144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca4e0-03fb-4678-bd55-ea6e640b4ae8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:46.876161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=be883e9492f14daa856a2a9eba500bb4, role_id=9f822a53892b43f9a38353a1bcfbb898)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.877602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.889986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 528/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:46 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/be883e9492f14daa856a2a9eba500bb4/roles/9f822a53892b43f9a38353a1bcfbb898 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:55:46.890783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:46.915779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:46.916468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:46.916749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:46.917025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:46.917797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:46.918109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:46.919786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:46.938141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 552/1080] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:47.002082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996683c8-b910-4e0a-94f7-6f4116ace0d3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:47.039469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:47.040621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:47.041121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:47.041638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:47.042640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:47.043124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:47.044936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:47.060989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 529/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:47.062932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:47.166107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f14ac8-9cb9-408b-988c-363634b8b0a8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:47.201330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:47.202193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:47.202472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:47.202742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] PATH_INFO: `/v3/users/8a1a3747cf6541cb92d1f6daad205e42` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:47.203931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] RBAC: Authorizing `identity:get_user(user_id=8a1a3747cf6541cb92d1f6daad205e42)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:47.205350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:47.207322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 553/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:47 2022] GET /identity/v3/users/8a1a3747cf6541cb92d1f6daad205e42 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:47.213099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:47.313625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b92b4-e060-4c8d-adfc-c6ba4200525a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:47.344809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9b064-d59b-4b3e-97d2-fd9c0f34893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:47.345707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b064-d59b-4b3e-97d2-fd9c0f34893c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:47.345993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b064-d59b-4b3e-97d2-fd9c0f34893c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:47.346269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b064-d59b-4b3e-97d2-fd9c0f34893c None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:47.347442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9b064-d59b-4b3e-97d2-fd9c0f34893c None admin] RBAC: Authorizing `identity:get_project(project_id=48921014d62f4fae927d37630394de00)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:47.349410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9b064-d59b-4b3e-97d2-fd9c0f34893c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:47.351145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 530/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:55:47 2022] GET /identity/v3/projects/48921014d62f4fae927d37630394de00 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:47.356970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:47.450242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c980e-47e8-48b9-8a3f-3517bab1886e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:47.482455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084874d-c07a-42f5-b7ed-4979c9451040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:47.483271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084874d-c07a-42f5-b7ed-4979c9451040 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:47.483551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084874d-c07a-42f5-b7ed-4979c9451040 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:47.483826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084874d-c07a-42f5-b7ed-4979c9451040 None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00/users/8a1a3747cf6541cb92d1f6daad205e42/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:47.485791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084874d-c07a-42f5-b7ed-4979c9451040 None admin] RBAC: Authorizing `identity:create_grant(project_id=48921014d62f4fae927d37630394de00, user_id=8a1a3747cf6541cb92d1f6daad205e42, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:47.487210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084874d-c07a-42f5-b7ed-4979c9451040 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:47.500063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 554/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:47 2022] PUT /identity/v3/projects/48921014d62f4fae927d37630394de00/users/8a1a3747cf6541cb92d1f6daad205e42/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 13:55:49.167331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bd1cc-f520-4113-b160-f7877a91b579 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.167850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bd1cc-f520-4113-b160-f7877a91b579 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.167850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bd1cc-f520-4113-b160-f7877a91b579 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.169490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 531/1085] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:49.174604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.175020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.175270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.191571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:49.192766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:49.255233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 555/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:49.278009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bd1cc-f520-4113-b160-f7877a91b579 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.373145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bd1cc-f520-4113-b160-f7877a91b579 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:49.404586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:49.405389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.405695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.405969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.420356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:49.429653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 13:55:49.430874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 532/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:55:49.436722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.531025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bbe11-0d13-4e19-a6de-ecd20226aac5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:49.566828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:49.567492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.567769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.568038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.568778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:49.569077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:49.570460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f464e-d3a9-474b-a198-44d12e6d18a3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:49.578454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 556/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:49.584276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.679929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe37e-e310-484e-a188-49da1b431bf1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:49.710822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:49.711603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.711878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.712145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.726265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:49.728164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:49.732480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece429-6a21-431d-a97a-7e8293300cb6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.732767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece429-6a21-431d-a97a-7e8293300cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.733048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece429-6a21-431d-a97a-7e8293300cb6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.734716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 557/1089] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:49.740566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.740846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.741121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.748733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:49.749971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 533/1090] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:49.756028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.756993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:49.758187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:49.819938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 558/1091] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:49.842969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.850105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f646-4704-49fa-9530-9b4446247170 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:49.881973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:49.882630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.882914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.883192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.883899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:49.884207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:49.885582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:49.897381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 534/1092] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:49.902830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.936531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5c2b5-795d-4050-b44d-0200c966f151 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:49.968044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:49.968823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:49.969105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:49.969378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:49.979571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:55:49.986362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:55:49.992359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 559/1093] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:49.993321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:49.994340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862044b-7b33-4f3e-929b-491cd4b500d3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.026401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.027187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.027471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.027746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.034556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.036603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.050466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 13:55:50.051865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 535/1094] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:50.057253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.089327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5518930-3402-4072-8a6d-f6143ebd07f8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.121016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.121700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.121978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.122246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.122982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:50.123284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.124641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.132412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 560/1095] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:55:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:50.137846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.152439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075542ca-524a-46a6-a17b-3758fd64ca35 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.185312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.186018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.186303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.186627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.187412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:50.187723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.189143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.206115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 536/1096] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:50.212335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.229221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8309c-fffb-47ee-9df1-aa3d339f4dec None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.260644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.261504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.261805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.262069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] PATH_INFO: `/v3/users/8a1a3747cf6541cb92d1f6daad205e42` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.263235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] RBAC: Authorizing `identity:get_user(user_id=8a1a3747cf6541cb92d1f6daad205e42)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.264650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.266281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 561/1097] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/users/8a1a3747cf6541cb92d1f6daad205e42 => generated 285 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:50.271795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.305902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eef2e5-a57d-4251-b055-1bbdaa7f2c7d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.337219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.337888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.338175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.338455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.367007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf83055-7884-4fae-a9c3-902fa2e70f34 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.398943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.399580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.399856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.400124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.402347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.403793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.462690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.464035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.495797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 537/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 13:55:50.501386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.560087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 562/1099] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 13:55:50.561361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.592044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f10f-4d76-4033-9f80-a8029409b84d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.624610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.625396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.625710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.625983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.635736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.637179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.652473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304537d1-7cd2-4b5c-b9a0-e4c073f8068b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.653857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:55:50.658654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 538/1100] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:50.661420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.686292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.687143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.687426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.687700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.688863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] RBAC: Authorizing `identity:get_project(project_id=48921014d62f4fae927d37630394de00)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.690319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.692047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 563/1101] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/projects/48921014d62f4fae927d37630394de00 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:50.697983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.761406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734b33a-77a0-45bc-8d6a-a248e1ffa5bf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.789155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214176-5acb-4ec9-a194-561302ba0c3a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.794155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.794815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.795098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.795375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.796085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:50.796394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.797786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.808482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 539/1102] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:50.813933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:50.820665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.821389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.821798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.822145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.823047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=48921014d62f4fae927d37630394de00, user.id=8a1a3747cf6541cb92d1f6daad205e42) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:50.823428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.824955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.845587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 564/1103] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/role_assignments?user.id=8a1a3747cf6541cb92d1f6daad205e42&scope.project.id=48921014d62f4fae927d37630394de00&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:55:50.914370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f98675-5eea-4732-aec4-e13862f117b1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:50.947912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:50.948724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:50.949006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:50.949281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:50.956506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:50.958518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:50.972674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:55:50.974607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 540/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:55:50.980584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:51.077367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118025-410d-46e0-b7df-4322135d3a7e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:51.110489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:51.111151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:51.111434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:51.111708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:51.112486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:51.112795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:51.114236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168c87b-8040-4d33-9e48-337956f5e08b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:51.125743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 565/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:55:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:51.132321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:51.226288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e2f0-f7e8-4050-a21a-912616f6cfa3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:51.258242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:51.258898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:51.259181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:51.259458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:51.260283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] RBAC: Adding query filter params (role.id=9f822a53892b43f9a38353a1bcfbb898, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=be883e9492f14daa856a2a9eba500bb4) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:51.260595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:51.262064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41f11-6027-4acc-bbc1-ebeeacd5f96a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:51.267691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 541/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:51 2022] GET /identity/v3/role_assignments?user.id=be883e9492f14daa856a2a9eba500bb4&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=9f822a53892b43f9a38353a1bcfbb898 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:53.107814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a501ad-ebb7-4375-9217-762f2c33d194 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:53.108300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a501ad-ebb7-4375-9217-762f2c33d194 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:53.108404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a501ad-ebb7-4375-9217-762f2c33d194 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:53.109748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 566/1107] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:53.114978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:53.115357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:53.115519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:53.131452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:53.132607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:53.193603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 542/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:55:53.218151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a501ad-ebb7-4375-9217-762f2c33d194 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:53.311366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a501ad-ebb7-4375-9217-762f2c33d194 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:53.345357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135891e6-a940-4063-9c54-6f77451098c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:53.346150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135891e6-a940-4063-9c54-6f77451098c1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:53.346427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135891e6-a940-4063-9c54-6f77451098c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:53.346693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135891e6-a940-4063-9c54-6f77451098c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:53.348424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135891e6-a940-4063-9c54-6f77451098c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:53.349808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135891e6-a940-4063-9c54-6f77451098c1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:53.351378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 567/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:53.356788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:53.454637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6a39-f8ee-4d1f-aacb-0cea91e7c90b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:53.486015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ced49-b8a3-47ca-8c43-84bfe480ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:53.486681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ced49-b8a3-47ca-8c43-84bfe480ecc4 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:53.486962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ced49-b8a3-47ca-8c43-84bfe480ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:53.487237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ced49-b8a3-47ca-8c43-84bfe480ecc4 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:53.487952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ced49-b8a3-47ca-8c43-84bfe480ecc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:53.489961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ced49-b8a3-47ca-8c43-84bfe480ecc4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:53.509202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 543/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:55:53 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:55:55.773920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17b48-a71d-4c95-85fc-c416f7c9a49b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:55.774478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17b48-a71d-4c95-85fc-c416f7c9a49b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:55.774478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17b48-a71d-4c95-85fc-c416f7c9a49b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:55.775850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 568/1111] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:55.781036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:55.781431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:55.781628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:55.798658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:55.799835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:55.862054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 544/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:55.885331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f17b48-a71d-4c95-85fc-c416f7c9a49b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:55.979970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f17b48-a71d-4c95-85fc-c416f7c9a49b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:56.010870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:56.011705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:56.011978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:56.012244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] PATH_INFO: `/v3/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:56.013716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] RBAC: Authorizing `identity:get_role(role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:56.015063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:56.016389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 569/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:55 2022] GET /identity/v3/roles/f7fbbda498344183afd6e30baed3c90a => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:56.022425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:56.112377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02980a7-0d61-436a-95db-1156cb2c36e7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:56.143041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:56.143887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:56.144165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:56.144985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] PATH_INFO: `/v3/users/a661debcd7d6428e95b628e11c8e75a2` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:56.157635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=a661debcd7d6428e95b628e11c8e75a2)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:56.159050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:56.161255 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 545/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:56 2022] GET /identity/v3/users/a661debcd7d6428e95b628e11c8e75a2 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:56.166947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:56.259057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b193a-c192-41e3-8be7-8ce09816a25d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:56.290043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:56.290668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:56.290978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:56.291251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:56.352632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:56.354035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:56.443819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 570/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:55:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:55:56.449451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:56.540824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3615aaf-5d72-4ff6-bb62-71bfa5842fe5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:56.572216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd58a2-f0ec-440e-9c54-c18c44b5f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:56.573046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd58a2-f0ec-440e-9c54-c18c44b5f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:56.573318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd58a2-f0ec-440e-9c54-c18c44b5f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:56.573620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd58a2-f0ec-440e-9c54-c18c44b5f1f4 None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:56.574870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd58a2-f0ec-440e-9c54-c18c44b5f1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=48921014d62f4fae927d37630394de00)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:56.576269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd58a2-f0ec-440e-9c54-c18c44b5f1f4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:56.577942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 546/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:55:56 2022] GET /identity/v3/projects/48921014d62f4fae927d37630394de00 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:56.583936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:56.675658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f347c4-d02a-49d0-a3e8-aca3911efc99 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:56.706215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:56.707346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:56.707639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:56.707912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:56.708723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] RBAC: Adding query filter params (role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=48921014d62f4fae927d37630394de00, user.id=a661debcd7d6428e95b628e11c8e75a2) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:55:56.709033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:56.710473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ce8a-178e-49c0-b059-7445a8f4b0e5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:56.715566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 571/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:55:56 2022] GET /identity/v3/role_assignments?user.id=a661debcd7d6428e95b628e11c8e75a2&scope.project.id=48921014d62f4fae927d37630394de00&role.id=f7fbbda498344183afd6e30baed3c90a => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:58.919685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902086e-ea1d-4aea-85a8-473011badf45 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:58.920216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902086e-ea1d-4aea-85a8-473011badf45 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:58.920216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902086e-ea1d-4aea-85a8-473011badf45 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:58.921624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 547/1118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:55:58.926848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:58.927219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:58.927397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:58.950195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:55:58.951451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:55:59.013749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 572/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:55:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:55:59.041195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902086e-ea1d-4aea-85a8-473011badf45 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:59.135723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902086e-ea1d-4aea-85a8-473011badf45 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:59.167677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:59.168768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:59.169045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:59.169316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] PATH_INFO: `/v3/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:59.170864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] RBAC: Authorizing `identity:get_role(role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:59.172168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:59.173522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 548/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:59 2022] GET /identity/v3/roles/f7fbbda498344183afd6e30baed3c90a => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:59.179267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:59.270374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3557e7-83ba-4c45-b501-02b8ca766389 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:59.302817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:59.303669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:59.303948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:59.304219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] PATH_INFO: `/v3/users/a661debcd7d6428e95b628e11c8e75a2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:59.305384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] RBAC: Authorizing `identity:get_user(user_id=a661debcd7d6428e95b628e11c8e75a2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:59.306825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:59.308418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 573/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:55:59 2022] GET /identity/v3/users/a661debcd7d6428e95b628e11c8e75a2 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:59.314060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:59.406819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ac24-ca28-4121-aa29-b460578ea9c2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:59.437929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823823-585e-49c2-b2ec-08db5f896292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:59.438707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823823-585e-49c2-b2ec-08db5f896292 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:59.438990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823823-585e-49c2-b2ec-08db5f896292 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:59.439266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823823-585e-49c2-b2ec-08db5f896292 None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:59.440428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823823-585e-49c2-b2ec-08db5f896292 None admin] RBAC: Authorizing `identity:get_project(project_id=48921014d62f4fae927d37630394de00)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:59.442378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823823-585e-49c2-b2ec-08db5f896292 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:59.444031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 549/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:55:59 2022] GET /identity/v3/projects/48921014d62f4fae927d37630394de00 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:55:59.449856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:55:59.541315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83aa37-25d9-4478-b915-c8799633d6bd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:55:59.572683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5f135-7910-4882-9855-8bfef95a5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:55:59.573539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f135-7910-4882-9855-8bfef95a5e75 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:55:59.573846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f135-7910-4882-9855-8bfef95a5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:55:59.574113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f135-7910-4882-9855-8bfef95a5e75 None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00/users/a661debcd7d6428e95b628e11c8e75a2/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:55:59.576236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f135-7910-4882-9855-8bfef95a5e75 None admin] RBAC: Authorizing `identity:create_grant(project_id=48921014d62f4fae927d37630394de00, user_id=a661debcd7d6428e95b628e11c8e75a2, role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:55:59.577756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f135-7910-4882-9855-8bfef95a5e75 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:55:59.590387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 574/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:55:59 2022] PUT /identity/v3/projects/48921014d62f4fae927d37630394de00/users/a661debcd7d6428e95b628e11c8e75a2/roles/f7fbbda498344183afd6e30baed3c90a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:56:01.780361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a04db-6773-4f46-9fcc-e7f17ff9b93e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:01.780933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a04db-6773-4f46-9fcc-e7f17ff9b93e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:01.780933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a04db-6773-4f46-9fcc-e7f17ff9b93e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:01.782305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 550/1124] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:01.787966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:01.788364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:01.788540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:01.805390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:01.806584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:01.868143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 575/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:01.890716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a04db-6773-4f46-9fcc-e7f17ff9b93e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:01.984912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a04db-6773-4f46-9fcc-e7f17ff9b93e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:02.015727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:02.016559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:02.016838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:02.017112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] PATH_INFO: `/v3/roles/f7fbbda498344183afd6e30baed3c90a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:02.018565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] RBAC: Authorizing `identity:get_role(role_id=f7fbbda498344183afd6e30baed3c90a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:02.020416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:02.021781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 551/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:01 2022] GET /identity/v3/roles/f7fbbda498344183afd6e30baed3c90a => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:02.027254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:02.118487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e348-2975-4851-b7ba-fc8377554306 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:02.149697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:02.150549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:02.150830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:02.151105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] PATH_INFO: `/v3/users/a661debcd7d6428e95b628e11c8e75a2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:02.152270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] RBAC: Authorizing `identity:get_user(user_id=a661debcd7d6428e95b628e11c8e75a2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:02.153726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:02.155326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 576/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:02 2022] GET /identity/v3/users/a661debcd7d6428e95b628e11c8e75a2 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:02.162828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:02.256278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcab18-0a56-4fc3-8ca1-04d54aa48a62 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:02.287682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:02.288312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:02.288593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:02.288871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:02.351031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:02.352403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:02.443220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 552/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:56:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:56:02.448930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:02.540835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b1cb-ebbb-4c12-947b-8881d542b649 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:02.572268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8bb43-00a5-4758-855e-278029cf8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:02.573109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bb43-00a5-4758-855e-278029cf8b60 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:02.573387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bb43-00a5-4758-855e-278029cf8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:02.573693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bb43-00a5-4758-855e-278029cf8b60 None admin] PATH_INFO: `/v3/projects/48921014d62f4fae927d37630394de00` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:02.574849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8bb43-00a5-4758-855e-278029cf8b60 None admin] RBAC: Authorizing `identity:get_project(project_id=48921014d62f4fae927d37630394de00)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:02.576270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8bb43-00a5-4758-855e-278029cf8b60 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:02.577967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 577/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:02 2022] GET /identity/v3/projects/48921014d62f4fae927d37630394de00 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:02.583932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:02.676318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761568-d24e-4821-88b1-7cc0fdac37e7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:02.707739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:02.708370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:02.708648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:02.708916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:02.709870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] RBAC: Adding query filter params (role.id=f7fbbda498344183afd6e30baed3c90a, scope.project.id=48921014d62f4fae927d37630394de00, user.id=a661debcd7d6428e95b628e11c8e75a2) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:02.710180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:02.711586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35639-b965-4f9a-92c0-510f5747ab33 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:02.717064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 553/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:56:02 2022] GET /identity/v3/role_assignments?user.id=a661debcd7d6428e95b628e11c8e75a2&scope.project.id=48921014d62f4fae927d37630394de00&role.id=f7fbbda498344183afd6e30baed3c90a => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:04.941754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530c2a-8f3a-410d-ab70-190894281457 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:04.942280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530c2a-8f3a-410d-ab70-190894281457 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:04.942280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530c2a-8f3a-410d-ab70-190894281457 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:04.943642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 578/1131] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:04.948843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:04.949243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:04.949399 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:04.965346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:04.966542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:05.028398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 554/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:05.052402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530c2a-8f3a-410d-ab70-190894281457 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:05.149051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530c2a-8f3a-410d-ab70-190894281457 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:05.180034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98ffc-01c6-4691-bd19-0acad0ab7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:05.180804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98ffc-01c6-4691-bd19-0acad0ab7000 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:05.181077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98ffc-01c6-4691-bd19-0acad0ab7000 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:05.181352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98ffc-01c6-4691-bd19-0acad0ab7000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:05.182520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98ffc-01c6-4691-bd19-0acad0ab7000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:05.183923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98ffc-01c6-4691-bd19-0acad0ab7000 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:05.185503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 579/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:05.191943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:05.283656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36f492-7b4a-4f15-8be5-8324636a3c75 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:05.316475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183111a6-45fd-4217-8b9f-9a0d6fbda0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:05.317125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183111a6-45fd-4217-8b9f-9a0d6fbda0fa None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:05.317409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183111a6-45fd-4217-8b9f-9a0d6fbda0fa None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:05.317719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183111a6-45fd-4217-8b9f-9a0d6fbda0fa None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:05.318435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183111a6-45fd-4217-8b9f-9a0d6fbda0fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:05.319853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183111a6-45fd-4217-8b9f-9a0d6fbda0fa None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:05.343277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 555/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:56:05 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:56:07.594409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b294129-b75a-4a69-b116-b81ea5922534 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:07.594940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b294129-b75a-4a69-b116-b81ea5922534 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:07.594940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b294129-b75a-4a69-b116-b81ea5922534 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:07.596341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 580/1135] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:07.601989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:07.602376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:07.602557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:07.619262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:07.620437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:07.683288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 556/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:07.707329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b294129-b75a-4a69-b116-b81ea5922534 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:07.804434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b294129-b75a-4a69-b116-b81ea5922534 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:07.834833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2c18a-1295-459e-a1b8-ea12e7286b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:07.835600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c18a-1295-459e-a1b8-ea12e7286b39 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:07.835877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c18a-1295-459e-a1b8-ea12e7286b39 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:07.836146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c18a-1295-459e-a1b8-ea12e7286b39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:07.837313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2c18a-1295-459e-a1b8-ea12e7286b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:07.838763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2c18a-1295-459e-a1b8-ea12e7286b39 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:07.840336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 581/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:07.846096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:07.938376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1469eef-4d2d-4384-9d83-5c14d0b7b78d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:07.969896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ce995-1ee9-4c94-a686-dcc49a18fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:07.970548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ce995-1ee9-4c94-a686-dcc49a18fc55 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:07.970826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ce995-1ee9-4c94-a686-dcc49a18fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:07.971101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ce995-1ee9-4c94-a686-dcc49a18fc55 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:07.971798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ce995-1ee9-4c94-a686-dcc49a18fc55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:07.973759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ce995-1ee9-4c94-a686-dcc49a18fc55 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:07.992340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 557/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:56:07 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:56:10.242386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59567c5b-5672-4a18-9f69-2d401fc7159e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:10.243395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59567c5b-5672-4a18-9f69-2d401fc7159e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:10.243395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59567c5b-5672-4a18-9f69-2d401fc7159e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:10.244286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 582/1139] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:10.249389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:10.249841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:10.249984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:10.268767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:10.269992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:10.332960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 558/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:10.356100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59567c5b-5672-4a18-9f69-2d401fc7159e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:10.449085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59567c5b-5672-4a18-9f69-2d401fc7159e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:10.480331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:10.481097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:10.481373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:10.481672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:10.491662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:56:10.498408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:56:10.499567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 583/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:56:10.506136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:10.598712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b9705-f1df-489e-85e1-39d25ab24ec0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:10.632822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:10.633491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:10.633807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:10.634084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:10.634829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:10.635135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:10.636494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:10.644379 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 559/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:10.650284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:10.743701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041228cd-e1ae-4ce6-9d85-406b1a3d9b1a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:10.774036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:10.774892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:10.775175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:10.775466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] PATH_INFO: `/v3/users/7aebbe8bdf17418e9c95dc15103a33a1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:10.788301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] RBAC: Authorizing `identity:get_user(user_id=7aebbe8bdf17418e9c95dc15103a33a1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:10.789744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:10.791362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 584/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:10 2022] GET /identity/v3/users/7aebbe8bdf17418e9c95dc15103a33a1 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:10.797277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:10.888510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8ed5-43c2-4cfe-8703-07d96d275455 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:10.920170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:10.920801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:10.921080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:10.921353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:10.982781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:10.984207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:11.073481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 560/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:56:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:56:11.079340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:11.172717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58e51-46d8-4a59-bd41-b3e24930ab53 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:11.204676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f980d7c-3de9-4fae-9784-891ebb8570d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:11.205517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f980d7c-3de9-4fae-9784-891ebb8570d6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:11.205827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f980d7c-3de9-4fae-9784-891ebb8570d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:11.206625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f980d7c-3de9-4fae-9784-891ebb8570d6 None admin] PATH_INFO: `/v3/projects/0db46f2692d944c8bfb42f798dc1165d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:11.207777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f980d7c-3de9-4fae-9784-891ebb8570d6 None admin] RBAC: Authorizing `identity:get_project(project_id=0db46f2692d944c8bfb42f798dc1165d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:11.209179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f980d7c-3de9-4fae-9784-891ebb8570d6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:11.210874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 585/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:11 2022] GET /identity/v3/projects/0db46f2692d944c8bfb42f798dc1165d => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:11.217041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:11.311526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180ec57-0896-4944-829d-b60cd850ca20 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:11.342214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:11.342846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:11.343129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:11.343401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:11.344221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=0db46f2692d944c8bfb42f798dc1165d, user.id=7aebbe8bdf17418e9c95dc15103a33a1) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:11.344532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:11.345977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a7f3-d8c5-4f2f-9087-45fc82582a18 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:11.351614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 561/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:56:11 2022] GET /identity/v3/role_assignments?user.id=7aebbe8bdf17418e9c95dc15103a33a1&scope.project.id=0db46f2692d944c8bfb42f798dc1165d&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:13.539828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41192c-6f9b-452a-8fea-7a1d4a4b9aec None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:13.540355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41192c-6f9b-452a-8fea-7a1d4a4b9aec None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:13.540355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41192c-6f9b-452a-8fea-7a1d4a4b9aec None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:13.541770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 586/1147] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:13.547058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:13.547462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:13.547621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:13.564357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:13.565587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:13.629882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 562/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:13.652130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41192c-6f9b-452a-8fea-7a1d4a4b9aec None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:13.746501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41192c-6f9b-452a-8fea-7a1d4a4b9aec None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:13.776895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:13.777690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:13.777971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:13.778240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:13.788339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:56:13.795462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:56:13.796581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 587/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:56:13.803229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:13.895031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602882-2fd6-4459-bdb4-23790c66d040 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:13.927764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:13.928427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:13.928708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:13.928982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:13.929758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:13.930066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:13.931422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:13.939016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 563/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:13.944915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:14.046242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cacc1-ccfc-4404-8bc7-a18de1860440 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:14.076195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:14.077043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:14.077319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:14.077612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] PATH_INFO: `/v3/users/7aebbe8bdf17418e9c95dc15103a33a1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:14.078766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] RBAC: Authorizing `identity:get_user(user_id=7aebbe8bdf17418e9c95dc15103a33a1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:14.080176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:14.082325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 588/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:13 2022] GET /identity/v3/users/7aebbe8bdf17418e9c95dc15103a33a1 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:14.088420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:14.181017 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f89da-454a-45c0-a9e3-0a471435b46c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:14.211906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314e95-c94d-4669-a6da-a2dbf1115269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:14.212754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314e95-c94d-4669-a6da-a2dbf1115269 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:14.213036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314e95-c94d-4669-a6da-a2dbf1115269 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:14.213312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314e95-c94d-4669-a6da-a2dbf1115269 None admin] PATH_INFO: `/v3/projects/0db46f2692d944c8bfb42f798dc1165d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:14.214505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314e95-c94d-4669-a6da-a2dbf1115269 None admin] RBAC: Authorizing `identity:get_project(project_id=0db46f2692d944c8bfb42f798dc1165d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:14.215911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314e95-c94d-4669-a6da-a2dbf1115269 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:14.217588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 564/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:14 2022] GET /identity/v3/projects/0db46f2692d944c8bfb42f798dc1165d => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:14.224082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:14.318575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e67b6-7f18-457b-87ac-44ddbbd72887 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:14.349237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6468c-48fc-4643-b4b1-e342306dd006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:14.350131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6468c-48fc-4643-b4b1-e342306dd006 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:14.350408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6468c-48fc-4643-b4b1-e342306dd006 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:14.350675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6468c-48fc-4643-b4b1-e342306dd006 None admin] PATH_INFO: `/v3/projects/0db46f2692d944c8bfb42f798dc1165d/users/7aebbe8bdf17418e9c95dc15103a33a1/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:14.352582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6468c-48fc-4643-b4b1-e342306dd006 None admin] RBAC: Authorizing `identity:create_grant(project_id=0db46f2692d944c8bfb42f798dc1165d, user_id=7aebbe8bdf17418e9c95dc15103a33a1, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:14.354016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6468c-48fc-4643-b4b1-e342306dd006 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:14.367209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 589/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:56:14 2022] PUT /identity/v3/projects/0db46f2692d944c8bfb42f798dc1165d/users/7aebbe8bdf17418e9c95dc15103a33a1/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:56:16.552564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a453c9-8748-4347-9085-fbb3f448a920 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:16.553092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a453c9-8748-4347-9085-fbb3f448a920 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:16.553092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a453c9-8748-4347-9085-fbb3f448a920 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:16.554485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 565/1154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:16.559756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:16.560126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:16.560306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:16.576359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:16.577535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:16.642584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 590/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:16.666188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a453c9-8748-4347-9085-fbb3f448a920 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:16.763192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a453c9-8748-4347-9085-fbb3f448a920 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:16.795517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:16.796312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:16.796598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:16.796873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:16.808226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:56:16.815056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:56:16.816289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 566/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:56:16.822313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:16.914904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eca97-3a87-4132-9a9c-4fd8f0caed56 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:16.946022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:16.946677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:16.946960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:16.947236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:16.947975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:16.948280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:16.949650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:16.957792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 591/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:56:16.963522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:17.055084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90baeb-4fa9-4cf3-b015-870266c1aa4f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:17.086274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:17.087064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:17.087343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:17.087616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] PATH_INFO: `/v3/users/7aebbe8bdf17418e9c95dc15103a33a1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:17.088766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] RBAC: Authorizing `identity:get_user(user_id=7aebbe8bdf17418e9c95dc15103a33a1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:17.090202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:17.091770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 567/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:16 2022] GET /identity/v3/users/7aebbe8bdf17418e9c95dc15103a33a1 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:17.098046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:17.191281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d053015-4b8b-47dc-9e25-2aab71282593 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:17.223059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:17.223694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:17.223977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:17.224250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:17.286314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:17.287756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:17.378927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 592/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:56:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 13:56:17.384639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:17.475830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271708a-22b5-43db-a9d4-ecb561ebcb4d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:17.506879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095586b-23ad-449e-beb6-5ae0773d2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:17.507707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095586b-23ad-449e-beb6-5ae0773d2996 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:17.507981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095586b-23ad-449e-beb6-5ae0773d2996 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:17.508246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095586b-23ad-449e-beb6-5ae0773d2996 None admin] PATH_INFO: `/v3/projects/0db46f2692d944c8bfb42f798dc1165d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:17.509374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095586b-23ad-449e-beb6-5ae0773d2996 None admin] RBAC: Authorizing `identity:get_project(project_id=0db46f2692d944c8bfb42f798dc1165d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:17.510808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095586b-23ad-449e-beb6-5ae0773d2996 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:17.512442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 568/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:17 2022] GET /identity/v3/projects/0db46f2692d944c8bfb42f798dc1165d => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:56:17.518314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:17.609806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e472-d7b0-4d2a-9d5f-c899a923edba None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:17.641487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:17.642152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:17.642434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:17.642708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:17.644048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=0db46f2692d944c8bfb42f798dc1165d, user.id=7aebbe8bdf17418e9c95dc15103a33a1) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:17.644358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:17.645787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1c9f8-10d6-4c35-a409-ffe16499c50c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:17.651292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 593/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:56:17 2022] GET /identity/v3/role_assignments?user.id=7aebbe8bdf17418e9c95dc15103a33a1&scope.project.id=0db46f2692d944c8bfb42f798dc1165d&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:19.884593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372034-791c-45d8-bfb6-5e037ea28032 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:19.885148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372034-791c-45d8-bfb6-5e037ea28032 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:19.885148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372034-791c-45d8-bfb6-5e037ea28032 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:19.886513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 569/1162] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:19.891540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:19.891927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:19.892090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:19.908556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:19.910362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:19.970862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 594/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:19.993181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f372034-791c-45d8-bfb6-5e037ea28032 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:20.095491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f372034-791c-45d8-bfb6-5e037ea28032 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:20.127712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:20.128350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:20.128631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:20.128905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:20.190858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:20.192231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:20.284358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 570/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:56:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:56:20.290356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:20.384643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414e5e1-f11e-4be8-b61f-e67bae2f925b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:20.416352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:20.417138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:20.417695 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:20.417972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:20.424946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:20.426399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:20.440090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bc1d1a3c-7e22-49d6-bf93-cec8a52d6aaf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 28 13:56:20.441316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 595/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:56:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:56:20.447307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:20.538535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07461f9-013e-41a6-b58e-186b18480f53 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:20.569969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:20.570611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:20.570887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:20.571160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:20.571857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:20.572157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:20.573490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772e43b-2c8b-4187-8f79-4b9190a55ebe None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:20.580182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 571/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Apr 28 13:56:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:22.789286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106381-9907-4c02-998d-20330e12a835 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:22.789870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106381-9907-4c02-998d-20330e12a835 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:22.789870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106381-9907-4c02-998d-20330e12a835 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:22.791219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 596/1167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:22.796487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edb4ad-8332-446f-b65f-87788516da50 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:22.796914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edb4ad-8332-446f-b65f-87788516da50 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:22.797044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edb4ad-8332-446f-b65f-87788516da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:22.813757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-31edb4ad-8332-446f-b65f-87788516da50 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:22.814934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-31edb4ad-8332-446f-b65f-87788516da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:22.876031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 572/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:22.898969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106381-9907-4c02-998d-20330e12a835 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:22.992609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106381-9907-4c02-998d-20330e12a835 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:23.023344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87283-faab-40ef-8de7-59da0a9fe354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:23.023976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87283-faab-40ef-8de7-59da0a9fe354 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:23.024253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87283-faab-40ef-8de7-59da0a9fe354 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:23.024520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87283-faab-40ef-8de7-59da0a9fe354 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:23.025242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87283-faab-40ef-8de7-59da0a9fe354 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:23.026624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87283-faab-40ef-8de7-59da0a9fe354 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:23.041053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 597/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Apr 28 13:56:22 2022] POST /identity/v3/domains => generated 267 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:56:25.273440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aac85-1919-4654-ba67-59b2bbf47af3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:25.274011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aac85-1919-4654-ba67-59b2bbf47af3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:25.274011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aac85-1919-4654-ba67-59b2bbf47af3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:25.275446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 573/1170] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:25.281366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:25.281803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:25.281964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:25.299680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:25.300875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:25.363954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 598/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:56:25.386439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aac85-1919-4654-ba67-59b2bbf47af3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:25.480525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aac85-1919-4654-ba67-59b2bbf47af3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:25.511964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf147c2e-af57-4bca-b7cb-6ed7c4ee97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:25.512792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf147c2e-af57-4bca-b7cb-6ed7c4ee97e3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:25.513069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf147c2e-af57-4bca-b7cb-6ed7c4ee97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:25.513339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf147c2e-af57-4bca-b7cb-6ed7c4ee97e3 None admin] PATH_INFO: `/v3/domains/9dd8a2dda6fd40c28dee687296906f89` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:25.523628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf147c2e-af57-4bca-b7cb-6ed7c4ee97e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9dd8a2dda6fd40c28dee687296906f89)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:25.525039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf147c2e-af57-4bca-b7cb-6ed7c4ee97e3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:25.526643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 574/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Apr 28 13:56:25 2022] GET /identity/v3/domains/9dd8a2dda6fd40c28dee687296906f89 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:25.532232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:25.633435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61e815-8eee-4860-a38f-038352c5f63e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:25.664546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea791c89-5c4f-4813-bc78-77633bf825a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:25.665187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea791c89-5c4f-4813-bc78-77633bf825a5 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:25.665464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea791c89-5c4f-4813-bc78-77633bf825a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:25.665762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea791c89-5c4f-4813-bc78-77633bf825a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:25.666452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea791c89-5c4f-4813-bc78-77633bf825a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:25.668130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea791c89-5c4f-4813-bc78-77633bf825a5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:25.691758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 599/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:56:25 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:56:27.944578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8838-85bb-4c1a-b09b-1e3b18d5db54 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:27.945133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8838-85bb-4c1a-b09b-1e3b18d5db54 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:27.945133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8838-85bb-4c1a-b09b-1e3b18d5db54 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:27.946508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 575/1174] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:27.951664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:27.952103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:27.952223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:27.968519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:27.969750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:28.031420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 600/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:28.056924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd8838-85bb-4c1a-b09b-1e3b18d5db54 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:28.155367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd8838-85bb-4c1a-b09b-1e3b18d5db54 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:28.186566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b2a7e-7987-4e7c-8512-90e829297d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:28.187402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b2a7e-7987-4e7c-8512-90e829297d01 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:28.187682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b2a7e-7987-4e7c-8512-90e829297d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:28.187959 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b2a7e-7987-4e7c-8512-90e829297d01 None admin] PATH_INFO: `/v3/domains/9dd8a2dda6fd40c28dee687296906f89` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:28.189115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b2a7e-7987-4e7c-8512-90e829297d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9dd8a2dda6fd40c28dee687296906f89)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:28.190630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b2a7e-7987-4e7c-8512-90e829297d01 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:28.192222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 576/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Apr 28 13:56:28 2022] GET /identity/v3/domains/9dd8a2dda6fd40c28dee687296906f89 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:28.198057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:28.289041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3642-bc7c-4e96-80ac-078688b78da5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:28.319978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da911fe0-c6a4-4532-81cd-43ee42123ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:28.320629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da911fe0-c6a4-4532-81cd-43ee42123ad9 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:28.320914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da911fe0-c6a4-4532-81cd-43ee42123ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:28.321186 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da911fe0-c6a4-4532-81cd-43ee42123ad9 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:28.321913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da911fe0-c6a4-4532-81cd-43ee42123ad9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:28.323331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da911fe0-c6a4-4532-81cd-43ee42123ad9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:28.342712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 601/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:56:28 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:56:30.605285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693da9-35e0-46a4-b741-80dd26eb2331 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:30.605882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693da9-35e0-46a4-b741-80dd26eb2331 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:30.605882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693da9-35e0-46a4-b741-80dd26eb2331 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:30.607250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 577/1178] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:30.612808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:30.613193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:30.613348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:30.630484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:30.631655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:30.692954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 602/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:30.715476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693da9-35e0-46a4-b741-80dd26eb2331 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:30.810469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693da9-35e0-46a4-b741-80dd26eb2331 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:30.840897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:30.841701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:30.841984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:30.842258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:30.852711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:56:30.859599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:56:30.860715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 578/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:56:30.866999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:30.958016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692df2a-096f-4003-b8dd-ab43bb69598c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:30.990136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:30.990784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:30.991066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:30.991340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:30.992076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:30.992382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:30.993765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:31.001329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 603/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:31.007053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:31.099212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe021-7003-47d0-b144-e945b344d6c8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:31.131184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:31.131979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:31.132262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:31.132539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] PATH_INFO: `/v3/users/07d7fbb0ae2849e788320797f91d2667` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:31.145227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] RBAC: Authorizing `identity:get_user(user_id=07d7fbb0ae2849e788320797f91d2667)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:31.146696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:31.148324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 579/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:31 2022] GET /identity/v3/users/07d7fbb0ae2849e788320797f91d2667 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:31.153986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:31.247876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0954-fcc1-4d78-95b1-589a2762895c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:31.280249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:31.280881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:31.281165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:31.281443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:31.348545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:31.350020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:31.441837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 604/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:56:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:56:31.447637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:31.539103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7a93-1fab-4628-8232-ff791bcfab09 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:31.570934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861d65a-5d69-4d74-9048-5556fa9e9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:31.571778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861d65a-5d69-4d74-9048-5556fa9e9e8d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:31.572061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861d65a-5d69-4d74-9048-5556fa9e9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:31.572336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861d65a-5d69-4d74-9048-5556fa9e9e8d None admin] PATH_INFO: `/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:31.573524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861d65a-5d69-4d74-9048-5556fa9e9e8d None admin] RBAC: Authorizing `identity:get_project(project_id=4830dd2af74c4b9aa8c0309f7b441d62)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:31.574968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861d65a-5d69-4d74-9048-5556fa9e9e8d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:31.576628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 580/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:31 2022] GET /identity/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:31.582400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:31.674298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7aecc-8dea-424d-84f6-1322f0c429af None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:31.705393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:31.706005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:31.706292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:31.706570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:31.707391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=4830dd2af74c4b9aa8c0309f7b441d62, user.id=07d7fbb0ae2849e788320797f91d2667) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:31.707706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:31.709117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319dc7b-62a6-4c7a-a53b-a3c1226d6243 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:31.714285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 605/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:56:31 2022] GET /identity/v3/role_assignments?user.id=07d7fbb0ae2849e788320797f91d2667&scope.project.id=4830dd2af74c4b9aa8c0309f7b441d62&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:56:33.912225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc74c-e2e5-4f73-9411-3dc7a46e5a8c None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:33.912787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc74c-e2e5-4f73-9411-3dc7a46e5a8c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:33.912787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc74c-e2e5-4f73-9411-3dc7a46e5a8c None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:33.914165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 581/1186] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:33.919555 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:33.919945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:33.920096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:33.936615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:33.937821 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:33.998573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 606/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:34.020045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc74c-e2e5-4f73-9411-3dc7a46e5a8c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:34.116123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc74c-e2e5-4f73-9411-3dc7a46e5a8c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:34.148049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:34.148833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:34.149112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:34.149382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:34.159416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:56:34.166313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:56:34.167686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 582/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:56:34.173762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:34.264567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4f5c3-300f-4749-b569-9bde49dee5a0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:34.295410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:34.296053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:34.296335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:34.296612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:34.297342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:34.297673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:34.299557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:34.307033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 607/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:34.312820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:34.406471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b489f33-2fd8-4aa1-a559-14d4805fdf36 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:34.437736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:34.438525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:34.438800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:34.439073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] PATH_INFO: `/v3/users/07d7fbb0ae2849e788320797f91d2667` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:34.440822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] RBAC: Authorizing `identity:get_user(user_id=07d7fbb0ae2849e788320797f91d2667)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:34.442257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:34.443834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 583/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:34 2022] GET /identity/v3/users/07d7fbb0ae2849e788320797f91d2667 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:34.449924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:34.543057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648dd01-665b-407a-a63a-2181697252e8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:34.573562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c250c-d957-4c30-94fe-7d4107316f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:34.574428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c250c-d957-4c30-94fe-7d4107316f58 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:34.574704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c250c-d957-4c30-94fe-7d4107316f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:34.574970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c250c-d957-4c30-94fe-7d4107316f58 None admin] PATH_INFO: `/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:34.576126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c250c-d957-4c30-94fe-7d4107316f58 None admin] RBAC: Authorizing `identity:get_project(project_id=4830dd2af74c4b9aa8c0309f7b441d62)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:34.577544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c250c-d957-4c30-94fe-7d4107316f58 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:34.579220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 608/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:34 2022] GET /identity/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:34.584918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:34.676262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676f67-857b-48b3-8621-78936e4b5dae None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:34.706373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d14d-2647-4b1f-b204-2fc1817effa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:34.707175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d14d-2647-4b1f-b204-2fc1817effa0 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:34.707456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d14d-2647-4b1f-b204-2fc1817effa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:34.707724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d14d-2647-4b1f-b204-2fc1817effa0 None admin] PATH_INFO: `/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62/users/07d7fbb0ae2849e788320797f91d2667/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:34.709644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9d14d-2647-4b1f-b204-2fc1817effa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4830dd2af74c4b9aa8c0309f7b441d62, user_id=07d7fbb0ae2849e788320797f91d2667, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:34.711053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9d14d-2647-4b1f-b204-2fc1817effa0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:34.723482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 584/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:56:34 2022] PUT /identity/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62/users/07d7fbb0ae2849e788320797f91d2667/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:56:36.958129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937ec2-b0f3-4e62-81ab-890ccc9a81af None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:36.958676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937ec2-b0f3-4e62-81ab-890ccc9a81af None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:36.958676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937ec2-b0f3-4e62-81ab-890ccc9a81af None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:36.960027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 609/1193] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:56:36.965261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:36.965713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:36.965831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:36.981833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:56:36.982990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:56:37.043764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 585/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:56:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:56:37.067041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5937ec2-b0f3-4e62-81ab-890ccc9a81af None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:37.162242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5937ec2-b0f3-4e62-81ab-890ccc9a81af None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:37.193678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:37.194448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:37.194723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:37.194993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:37.204750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:56:37.211439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:56:37.212554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 610/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:56:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:56:37.218569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:37.309308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f7e64-d51f-4c28-9f30-e1eff7ccfc32 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:37.340332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:37.340976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:37.341256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:37.341529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:37.342289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:37.342589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:37.343931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:37.351413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 586/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:56:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:37.356933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:37.449038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e58d5-cb79-4dc3-ae47-a3b144d4a5dd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:37.479626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:37.480417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:37.480698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:37.480968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] PATH_INFO: `/v3/users/07d7fbb0ae2849e788320797f91d2667` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:37.482156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] RBAC: Authorizing `identity:get_user(user_id=07d7fbb0ae2849e788320797f91d2667)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:37.483563 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:37.485143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 611/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Apr 28 13:56:37 2022] GET /identity/v3/users/07d7fbb0ae2849e788320797f91d2667 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:37.491393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:37.591100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f4df-988f-419b-87fc-6210b85a6899 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:37.622936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:37.623681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:37.624059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:37.624516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:37.687241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:37.688657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:37.777448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 587/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:56:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:56:37.783737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:37.875607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49fd2-702c-4da5-bd90-b83d0ea00a3b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:37.906653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad0dbf-77fe-4b27-bebd-4d80490ef26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:37.907489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad0dbf-77fe-4b27-bebd-4d80490ef26d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:37.908381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad0dbf-77fe-4b27-bebd-4d80490ef26d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:37.908798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad0dbf-77fe-4b27-bebd-4d80490ef26d None admin] PATH_INFO: `/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:37.910770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad0dbf-77fe-4b27-bebd-4d80490ef26d None admin] RBAC: Authorizing `identity:get_project(project_id=4830dd2af74c4b9aa8c0309f7b441d62)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:37.913026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad0dbf-77fe-4b27-bebd-4d80490ef26d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:37.915757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 612/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Apr 28 13:56:37 2022] GET /identity/v3/projects/4830dd2af74c4b9aa8c0309f7b441d62 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:56:37.922019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:56:38.013970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0881f9-1a98-4d1b-a5eb-d6cbc602ec4f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:56:38.046266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:56:38.046846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:56:38.047129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:56:38.047406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:56:38.048242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=4830dd2af74c4b9aa8c0309f7b441d62, user.id=07d7fbb0ae2849e788320797f91d2667) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:56:38.048570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:56:38.050043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eccfa-4d45-4ab4-942d-803d06c8e190 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:56:38.055537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 588/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:56:37 2022] GET /identity/v3/role_assignments?user.id=07d7fbb0ae2849e788320797f91d2667&scope.project.id=4830dd2af74c4b9aa8c0309f7b441d62&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:38.769068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2f1a-1f6d-4a9f-b133-05106386e5ce None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:38.770043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2f1a-1f6d-4a9f-b133-05106386e5ce None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:38.770043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2f1a-1f6d-4a9f-b133-05106386e5ce None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:38.771023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 613/1201] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:57:38.776434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:38.776893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:38.776980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:38.795522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:57:38.796727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:57:38.879860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 589/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:57:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:57:38.904714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2f1a-1f6d-4a9f-b133-05106386e5ce None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:39.027777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2f1a-1f6d-4a9f-b133-05106386e5ce None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:39.065978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:39.067253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:39.067761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:39.068259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:39.083235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:39.083445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:39.105196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:39.106693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 614/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:39.112999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:39.224499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8fcba-e8d4-4929-a013-301e55c1d1b1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:39.260641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:39.261362 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:39.261707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:39.262025 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:39.262729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:39.263037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:39.264634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccde7de-044b-4128-b5e4-b36b82514532 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:39.276979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 590/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:39.283116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:39.396059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108617-4224-45a5-b4f0-0406439389ba None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:39.436747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e425cb-bedc-403c-9151-ad0c6c71cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:39.440017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e425cb-bedc-403c-9151-ad0c6c71cc9d None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:39.440344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e425cb-bedc-403c-9151-ad0c6c71cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:39.440625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e425cb-bedc-403c-9151-ad0c6c71cc9d None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:39.441348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e425cb-bedc-403c-9151-ad0c6c71cc9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:39.442872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e425cb-bedc-403c-9151-ad0c6c71cc9d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:39.469788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 615/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Apr 28 13:57:39 2022] POST /identity/v3/users => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:57:41.978525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7952b7-c081-42af-9602-51b498f10d41 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:41.979075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7952b7-c081-42af-9602-51b498f10d41 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:41.979075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7952b7-c081-42af-9602-51b498f10d41 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:41.980696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 591/1206] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:57:41.989151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:41.989762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:41.989762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:42.009740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:57:42.011460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:57:42.088918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 616/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:57:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:57:42.114858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7952b7-c081-42af-9602-51b498f10d41 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:42.242758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7952b7-c081-42af-9602-51b498f10d41 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:42.278159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:42.279774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:42.280157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:42.280441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:42.291396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:57:42.299339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:57:42.300568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 592/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:57:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:42.307009 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:42.412293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8293f-f9d9-4feb-8464-805574e0b628 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:42.446470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:42.447143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:42.447427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:42.447703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:42.448447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:42.448826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:42.450159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:42.459602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 617/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:57:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:42.465316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:42.571823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422eb98-6e6e-4c30-96ed-e71b05a310c0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:42.610975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:42.611965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:42.612327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:42.612673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:42.623508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:42.625075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:42.643574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:42.644911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 593/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:42.651329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:42.762343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0634e7-f14b-4f5a-a173-028e2eb30a74 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:42.799859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:42.800676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:42.801061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:42.801439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:42.802210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:42.802518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:42.804503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:42.817287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 618/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:42.823052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:42.933386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26ca9-a507-4430-8c80-05fece24bd0f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:42.970907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:42.971711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:42.971991 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:42.972329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:42.980053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:42.981524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:42.996536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 13:57:43.003158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 594/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:43.004124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:43.127540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890060c7-06d6-4116-9391-2825b4a8c009 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:43.164728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:43.165698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:43.165986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:43.166269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:43.167202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:43.167517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:43.169026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:43.187309 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 619/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Apr 28 13:57:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:43.192957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:43.296805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfc971-7965-4966-967c-47fb5c7318b0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:43.333838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:43.334489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:43.334774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:43.335078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:43.404350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:43.405825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:43.506906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 595/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:57:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:57:43.512865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:43.613051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6dce-63bf-4a5d-aecc-78ce7f2db4fd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:43.651181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:43.651974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:43.652258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:43.654664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:43.664138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:43.666074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:43.684987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:43.690983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 620/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:43.692273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:43.798609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df2173-a715-4e75-8397-0e52dd989c12 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:43.834146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:43.835271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:43.835679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:43.836125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:43.836996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:43.837438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:43.839563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:43.854736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 596/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:43.861007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:43.968809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a6c3b-837b-4731-9599-e5fc02a73506 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:44.004397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:44.005190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:44.005469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:44.005768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:44.012813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:44.015105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:44.028392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:57:44.030495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 621/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:44.036453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:44.139624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb224ef-4d12-4e49-8dce-5aa56a2f0a73 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:44.175369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:44.176066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:44.176350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:44.176625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:44.177420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:44.177762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:44.179218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a659ef2-95f4-42c1-a4ba-662d55c112da None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:44.192651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 597/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:44.199714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:44.306629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c83f-6079-4b34-90da-fcde673b5a27 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:44.344018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:44.344668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:44.344945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:44.345221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:44.346149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=590c10bbd98b4dabbb7c35d389bf7e36) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:44.346489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:44.347956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e8da5-b3c9-4fea-b17a-d30905097cf9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:44.353869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 622/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:57:44 2022] GET /identity/v3/role_assignments?user.id=590c10bbd98b4dabbb7c35d389bf7e36&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:46.656098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555439-6b9a-40a7-9983-743b08eb0566 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:46.656635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555439-6b9a-40a7-9983-743b08eb0566 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:46.656635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555439-6b9a-40a7-9983-743b08eb0566 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:46.658265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 598/1220] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:57:46.663510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:46.663974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:46.664063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:46.683077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:57:46.684507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:57:46.754969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 623/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:57:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:57:46.777931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3555439-6b9a-40a7-9983-743b08eb0566 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:46.886476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3555439-6b9a-40a7-9983-743b08eb0566 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:46.923589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:46.924313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:46.924591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:46.924866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:46.935570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:57:46.942753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:57:46.952600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 599/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:46.952777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:47.051811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15378eb9-d028-43e7-abdb-3ebe5c6f81db None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:47.086898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:47.087681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:47.088020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:47.088303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:47.089053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:47.089362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:47.090758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:47.102077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 624/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:47.106840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:47.213484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758881c-539c-4688-b936-68f327c2a49f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:47.249108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:47.249941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:47.250226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:47.250501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:47.261968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:47.263509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:47.282225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:47.283800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 600/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:47.290510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:47.407808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c9bd-3073-44a3-a39f-43e98a0026d3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:47.444845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:47.445540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:47.445988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:47.446264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:47.447298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:47.447644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:47.449317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:47.462249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 625/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:47.468754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:47.570803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e015d4-5fb8-4ace-ac48-7d61ad0fd63d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:47.604120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:47.604935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:47.605216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:47.605492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:47.615424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:47.615424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:47.630594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 13:57:47.632084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 601/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:47.638806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:47.748625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34a23-6366-4697-bdea-e5f3f1a223c8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:47.784696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:47.785358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:47.785706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:47.785954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:47.786786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:47.787146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:47.788518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:47.810114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 626/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Apr 28 13:57:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:47.811488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:47.914333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2080-aa1a-4522-bfb0-ac40dbbb4b90 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:47.948253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:47.949047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:47.949328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:47.949637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:47.960272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:47.961734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:47.978284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:47.979439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 602/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:57:47.985230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:48.085999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1473-ca44-4cf0-91cc-53df7df855bd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:48.120084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:48.120799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:48.121085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:48.121358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:48.122623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:48.122940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:48.124294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:48.137463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 627/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:48.143840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:48.253531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9540daa-0802-4ff3-8f6f-7ea828a988be None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:48.290288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:48.291080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:48.291364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:48.291642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:48.298896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:48.300310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:48.314354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:57:48.315633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 603/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:48.321647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:48.423692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465a40-c693-4ab4-b24c-200adc8920b9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:48.457408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:48.458100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:48.458384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:48.458658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:48.459440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:48.460839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:48.462252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716c22-e3fd-418b-a3ae-b8fe9b390baf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:48.474553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 628/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 13:57:48.480350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:48.580199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c60c89-0f32-4060-afce-126a4380346b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:48.614049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3315762-8d3c-4364-b3e5-e72dd1fb2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:48.615041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315762-8d3c-4364-b3e5-e72dd1fb2d3d None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:48.615322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315762-8d3c-4364-b3e5-e72dd1fb2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:48.615594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315762-8d3c-4364-b3e5-e72dd1fb2d3d None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/590c10bbd98b4dabbb7c35d389bf7e36/roles/1fa7d0a0bce14884ba138dd76ad27bb0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:48.632989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3315762-8d3c-4364-b3e5-e72dd1fb2d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=590c10bbd98b4dabbb7c35d389bf7e36, role_id=1fa7d0a0bce14884ba138dd76ad27bb0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:48.634611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3315762-8d3c-4364-b3e5-e72dd1fb2d3d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:48.648837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 604/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:57:48 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/590c10bbd98b4dabbb7c35d389bf7e36/roles/1fa7d0a0bce14884ba138dd76ad27bb0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:57:50.988096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b28a-31ec-4fef-b31c-2b6b50450f8d None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:50.988691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b28a-31ec-4fef-b31c-2b6b50450f8d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:50.988875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b28a-31ec-4fef-b31c-2b6b50450f8d None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:50.990232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 629/1233] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:57:50.995526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:50.995932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:50.996073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:51.013058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:57:51.014341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:57:51.084522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 605/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:57:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 13:57:51.109463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25b28a-31ec-4fef-b31c-2b6b50450f8d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:51.214966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25b28a-31ec-4fef-b31c-2b6b50450f8d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:51.250956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:51.251673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:51.251952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:51.252220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:51.263093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:57:51.270252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 13:57:51.271576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 630/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Apr 28 13:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:51.278056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:51.381949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb1bf1-ea3a-4cd0-bd24-868187b794af None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:51.416899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:51.417749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:51.418130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:51.418506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:51.419353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:51.419756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:51.421236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:51.430404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 606/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Apr 28 13:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:51.436393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:51.547715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1acf4-a878-421c-a558-d18eaab61a07 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:51.583589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:51.584386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:51.584671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:51.584999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:51.596704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:51.598208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:51.614933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:51.616143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 631/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:51.622551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:51.738831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa0c2b-3e1c-47d0-98b0-aa0cd8566990 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:51.774375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:51.775138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:51.775514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:51.775796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:51.776511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:51.776820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:51.778234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:51.790809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 607/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:51.796626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:51.899455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9eb4-4237-450b-88b0-509b427c3235 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:51.935720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:51.936536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:51.936886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:51.937165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:51.945441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:51.947046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:51.961721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 13:57:51.962918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 632/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:51.969320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:52.075011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312bddc-9b81-4c08-b9fd-3bf385a9c545 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:52.112527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:52.113240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:52.113576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:52.113903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:52.114771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:52.115084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:52.116676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:52.136512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 608/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Apr 28 13:57:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:52.143041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:52.244791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33485ebc-94b6-4d59-a98b-42613190510c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:52.282911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:52.283647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:52.283973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:52.284377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:52.355470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:52.357715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:52.460316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 633/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:57:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:57:52.466294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:52.574466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f487-aea9-4f75-aaf3-fa484fc0dc97 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:52.609352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:52.612260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:52.612260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:52.612260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:52.621265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:52.623400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:52.643693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:52.645351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 609/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:52.652422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:52.765232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c555e-f281-45cc-b2de-d3d4f032b0df None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:52.805847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:52.808172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:52.808172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:52.808172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:52.808172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:52.808172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:52.810026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:52.822611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 634/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:52.829500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:52.935454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56052e17-00fd-4600-ad77-c5a7c694b513 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:52.970623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:52.971413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:52.971692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:52.971965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:52.978442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:52.979903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:52.993331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:57:52.994546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 610/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:57:53.001508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:53.104629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e7b9-9cac-4cf0-98da-a6ae2889a891 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:53.141542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:53.142255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:53.142535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:53.142808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:53.143604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:53.144206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:53.145874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca29b5-1e2c-4f46-b2f2-bd75382f3da5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:53.160525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 635/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:53.167155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:53.273889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725e6b-23ad-4d97-998a-fac3017d551f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:53.312278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:53.312935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:53.313239 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:53.313516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:53.314424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] RBAC: Adding query filter params (role.id=1fa7d0a0bce14884ba138dd76ad27bb0, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=590c10bbd98b4dabbb7c35d389bf7e36) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:53.314739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:53.316179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4ed4-c8c7-423b-b89c-2c3e05be15bf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:53.337592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 611/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:57:53 2022] GET /identity/v3/role_assignments?user.id=590c10bbd98b4dabbb7c35d389bf7e36&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=1fa7d0a0bce14884ba138dd76ad27bb0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:55.903518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184037e-7e9d-40d7-82b1-736a2634ecc6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:55.904070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184037e-7e9d-40d7-82b1-736a2634ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:55.904070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184037e-7e9d-40d7-82b1-736a2634ecc6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:55.905448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 636/1247] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:57:55.911528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:55.912079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:55.912182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:55.930158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:57:55.931452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:57:56.004688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 612/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:57:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:57:56.029183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184037e-7e9d-40d7-82b1-736a2634ecc6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:56.140438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184037e-7e9d-40d7-82b1-736a2634ecc6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:56.177974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:56.178612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:56.178981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:56.179419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:56.190055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:57:56.197271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:57:56.198971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 637/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:56.205439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:56.318436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385203-c823-481b-b665-637072f9c0f2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:56.354469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:56.355141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:56.355466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:56.355684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:56.356466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:56.356771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:56.358177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:56.366320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 613/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:56.372651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:56.488658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb78a40-0470-43b6-9582-ceb637385d56 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:56.525090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:56.525914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:56.526197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:56.526498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:56.536929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:56.538413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:56.556231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:56.562844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 638/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:56.564035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:56.669827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f67ed0-71cf-4eaa-af1a-79f4e7b2f02e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:56.705847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:56.706493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:56.706772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:56.707036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:56.707796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:56.708099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:56.709432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:56.720949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 614/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:56.726743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:56.825056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb751fe3-dbf4-4c3e-8d13-03ff21edb290 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:56.857420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:56.858255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:56.858533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:56.858811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:56.866472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:56.867909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:56.881711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 13:57:56.882910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 639/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:56.888882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:56.992880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e05c-8206-45c3-b742-300fa74add6f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:57.027058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:57.028482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:57.028758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:57.029028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:57.029890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:57.030186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:57.031598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:57.048874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 615/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Apr 28 13:57:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:57.054878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:57.161059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394edd-8598-4310-b12c-95ae84d5bc3a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:57.195638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:57.196295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:57.196560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:57.196832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:57.265482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:57.266973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:57.374763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 640/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:57:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:57:57.380800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:57.489374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0c89f-e669-4edb-89e5-be371868ab4d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:57.525334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:57.526173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:57.526460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:57.526737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:57.538058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:57.539803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:57.557661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:57:57.559129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 616/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:57:57.564998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:57.666730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64471a1b-7c4f-4bdf-9f1a-101576d884ac None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:57.704679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:57.705343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:57.705660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:57.705919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:57.706640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:57.706944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:57.708323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:57.729233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 641/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:57.730987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:57.837137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c742b9-3bdc-4b72-a76b-c5c4e52f4566 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:57.871438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:57.872251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:57.872543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:57.872796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:57.879290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:57.880728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:57.893198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:57:57.894400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 617/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 13:57:57.900364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:57.996370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a317a-2240-4679-ab91-01d08d1465b1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:58.027451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:58.028613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:58.028891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:58.029164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:58.030028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:58.030338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:58.031750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697c44-a6d9-4596-8863-ab29c4089c26 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:58.043240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 642/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:57:58.049847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:57:58.146190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186cbe8-639e-4dea-8f57-514009433d1a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:57:58.177712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:57:58.178351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:57:58.178628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:57:58.178901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:57:58.179814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=590c10bbd98b4dabbb7c35d389bf7e36) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:57:58.180118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:57:58.181745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0f11-f0f4-4411-b295-98f06ab1468f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:57:58.186929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 618/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:57:58 2022] GET /identity/v3/role_assignments?user.id=590c10bbd98b4dabbb7c35d389bf7e36&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=14e44e8972ac470caeba21b91a163d08 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:00.374382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2962-8995-48db-91a1-b50997c1ee53 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:00.374904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2962-8995-48db-91a1-b50997c1ee53 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:00.374904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2962-8995-48db-91a1-b50997c1ee53 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:00.376205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 643/1261] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:58:00.381509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:00.381932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:00.382083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:00.398085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:58:00.399257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:58:00.459950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 619/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:58:00.481986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2962-8995-48db-91a1-b50997c1ee53 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:00.574422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2962-8995-48db-91a1-b50997c1ee53 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:00.604722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:00.605479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:00.606331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:00.606605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:00.615967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:58:00.622849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:58:00.623984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 644/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:00.630347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:00.737459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf629f2-815e-4c29-8ee7-9ce0f7a5fab1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:00.769416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:00.770102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:00.770385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:00.770660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:00.771395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:00.771729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:00.773085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:00.780651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 620/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:00.786591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:00.880945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6889f-5295-4af1-871d-52e682aa9d79 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:00.916878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:00.917681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:00.917966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:00.918818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:00.928700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:00.930179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:00.946339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:58:00.947485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 645/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:00.953728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.045838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c596-0464-4e7b-8f1a-4b9c81668a24 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:01.077976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:01.078625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:01.078909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:01.079186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:01.079891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:01.080199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:01.081584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:01.092572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 621/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:01.098011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.191866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058858-404f-4ea6-8407-9d9818c6fe6a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:01.222727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:01.223508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:01.223792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:01.224067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:01.231675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:01.233097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:01.246136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 13:58:01.247832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 646/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:58:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:01.253410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.345983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab3bf-af62-49c2-8259-e0935129d3d0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:01.377859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:01.378514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:01.378811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:01.379072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:01.379901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:01.380210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:01.381649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:01.398611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 622/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Apr 28 13:58:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:01.404164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.502686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd68f3-99e6-4706-8f9e-b0a9860bd5e9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:01.533182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:01.533979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:01.534260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:01.534530 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:01.545100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:01.546538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:01.561895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:58:01.563042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 647/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:01.568667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.665411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2db915-a7ec-4905-b312-74c02e161d5f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:01.699662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:01.700311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:01.700590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:01.700867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:01.701588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:01.701897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:01.703263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:01.713870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 623/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:01.719980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.829867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9378-9d85-4f25-bd5c-ddd635ec1bea None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:01.861232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:01.862039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:01.862318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:01.862591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:01.868876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:01.870358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:01.883438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:58:01.884595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 648/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:01.891003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:01.982901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b092a-f1ff-412a-97f6-190f1eaacfb1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:02.013712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:02.014356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:02.014638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:02.014915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:02.015683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:02.015992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:02.017405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd6638-9f23-40ff-a97a-78b5ba09a7ca None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:02.029161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 624/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:02.035039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:02.126686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fb13-1581-4b8c-834a-4fa0c9db5609 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:02.158922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711fe7-b3a9-4994-965c-ddcabe0213c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:02.159807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711fe7-b3a9-4994-965c-ddcabe0213c5 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:02.160081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711fe7-b3a9-4994-965c-ddcabe0213c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:02.160350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711fe7-b3a9-4994-965c-ddcabe0213c5 None admin] PATH_INFO: `/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/590c10bbd98b4dabbb7c35d389bf7e36/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:02.162232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea711fe7-b3a9-4994-965c-ddcabe0213c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d95cf5ee1f45159b8b09db6f5a8345, user_id=590c10bbd98b4dabbb7c35d389bf7e36, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:02.163654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea711fe7-b3a9-4994-965c-ddcabe0213c5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:02.175810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 649/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Apr 28 13:58:02 2022] PUT /identity/v3/projects/70d95cf5ee1f45159b8b09db6f5a8345/users/590c10bbd98b4dabbb7c35d389bf7e36/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 13:58:04.368732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03e4d-4d54-4c47-bade-379347f416d0 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:04.369231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03e4d-4d54-4c47-bade-379347f416d0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:04.369231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03e4d-4d54-4c47-bade-379347f416d0 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:04.370596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 625/1274] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:58:04.376270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:04.376693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:04.376797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:04.392358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:58:04.393535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:58:04.456646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 650/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:58:04.479631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03e4d-4d54-4c47-bade-379347f416d0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:04.573300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03e4d-4d54-4c47-bade-379347f416d0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:04.604212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:04.604980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:04.605258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:04.606113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:04.615429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 13:58:04.622247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 13:58:04.623349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 626/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Apr 28 13:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:04.629427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:04.734164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b074a2-3f21-42a7-a404-d492155155ab None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:04.764356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:04.765005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:04.765278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:04.765547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:04.766305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:04.766603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:04.767950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:04.775840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 651/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Apr 28 13:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:04.782175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:04.874881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b99c-807a-42f6-9ea2-ecb43b851180 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:04.905965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:04.906733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:04.907009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:04.907280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:04.917234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:04.918703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:04.934034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:58:04.935169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 627/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:04.940855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:05.031641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea15b-32b5-403b-9f8f-dea51e96bcc8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:05.062197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:05.062827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:05.063103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:05.063375 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:05.064078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:05.064378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:05.065821 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:05.076636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 652/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:05.082630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:05.178460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6017bb-1ee8-49b2-b1b3-d839b9c2eee0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:05.209284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:05.210096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:05.210377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:05.210648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:05.218198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:05.219629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:05.232463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 13:58:05.233621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 628/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:58:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:05.239298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:05.331475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d87c7-f31c-45ce-a00e-a6073eedc10f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:05.361371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:05.362039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:05.362319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:05.362592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:05.363407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:05.363711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:05.365116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:05.381429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 653/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Apr 28 13:58:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:05.387475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:05.479776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde206d-3608-4850-9b8a-4f4eade3e7eb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:05.510679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:05.511306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:05.511584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:05.512457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:05.573901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:05.575932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:05.671096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 629/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Apr 28 13:58:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 13:58:05.676862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:05.767206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e4f7-5828-40c7-ba1c-19303c1d7c3b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:05.798417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:05.799177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:05.799454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:05.799724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:05.809488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:05.810920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:05.827483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 13:58:05.828606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 654/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 13:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:05.833981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:05.924142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42639497-8b76-4f5b-aed4-3f0593fad0d1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:05.955094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:05.955735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:05.956014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:05.956308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:05.956988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:05.957290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:05.958660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:05.969273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 630/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Apr 28 13:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:05.974613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:06.066076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80605bf-fac9-4bfa-bf39-7f1f8b25945a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:06.097582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:06.098368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:06.098647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:06.098921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:06.106050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:06.107488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:06.119947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 13:58:06.121118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 655/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Apr 28 13:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:06.126966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:06.219547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9482e-da7c-4b89-9520-e72a3c01b126 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:06.250151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:06.250789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:06.251066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:06.251337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:06.252099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:06.252406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:06.253835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a93f2-081f-4a4e-9559-9711b7c4d94d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:06.264889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 631/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Apr 28 13:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:06.270768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:06.364739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6b12-5a83-4662-b4c3-b068f05982d9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:06.395685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:06.396314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:06.396595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:06.396867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:06.397717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] RBAC: Adding query filter params (role.id=14e44e8972ac470caeba21b91a163d08, scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345, user.id=590c10bbd98b4dabbb7c35d389bf7e36) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:06.398027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:06.399436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b556-34a5-4dc5-b132-299cbceb5a14 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:06.405477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 656/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Apr 28 13:58:06 2022] GET /identity/v3/role_assignments?user.id=590c10bbd98b4dabbb7c35d389bf7e36&scope.project.id=70d95cf5ee1f45159b8b09db6f5a8345&role.id=14e44e8972ac470caeba21b91a163d08 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:08.655948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd520-0f59-4fb3-9169-9fb698317d87 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:08.656481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd520-0f59-4fb3-9169-9fb698317d87 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:08.656481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd520-0f59-4fb3-9169-9fb698317d87 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:08.657886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 632/1288] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:58:08.663183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:08.663588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:08.663759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:08.681005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:58:08.682229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:58:08.748983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 657/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:58:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:58:08.770907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd520-0f59-4fb3-9169-9fb698317d87 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:08.866758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd520-0f59-4fb3-9169-9fb698317d87 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:08.898503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:08.899285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:08.899565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:08.899833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:08.900469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:08.901854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:08.913186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 28 13:58:08.914569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 633/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:58:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:08.920775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:09.012710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0ff13-f055-4959-81b0-9046a76ea795 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:09.043564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:09.044206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:09.044482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:09.044753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:09.045442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:09.045767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:09.047105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26023f-db41-4369-93e0-a9defcfc0a18 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:09.051641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 658/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Apr 28 13:58:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:09.057119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:09.150626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824fc4a-d2f3-4ea9-b385-edfaceb63733 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:09.182794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:09.183926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:09.184208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:09.184480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:09.185173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:09.185475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:09.186857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fee1f-d469-488d-b047-40e34bc03db7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:09.191115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 634/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Apr 28 13:58:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:11.393616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343123af-0e4a-4a71-a86a-8861e2e2525e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:11.394143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343123af-0e4a-4a71-a86a-8861e2e2525e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:11.394238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343123af-0e4a-4a71-a86a-8861e2e2525e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:11.395548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 659/1293] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:58:11.400641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650006e-5719-4b15-a1cf-20c5d1e083f5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:11.401054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650006e-5719-4b15-a1cf-20c5d1e083f5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:11.401195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650006e-5719-4b15-a1cf-20c5d1e083f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:11.418624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1650006e-5719-4b15-a1cf-20c5d1e083f5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:58:11.419786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1650006e-5719-4b15-a1cf-20c5d1e083f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:58:11.484746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 635/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:58:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:58:11.507256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343123af-0e4a-4a71-a86a-8861e2e2525e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:11.602090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343123af-0e4a-4a71-a86a-8861e2e2525e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:11.634414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a477c-a1ed-48b9-8117-456953536c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:11.635285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a477c-a1ed-48b9-8117-456953536c89 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:11.635586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a477c-a1ed-48b9-8117-456953536c89 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:11.635862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a477c-a1ed-48b9-8117-456953536c89 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:11.637179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a477c-a1ed-48b9-8117-456953536c89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:11.638943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a477c-a1ed-48b9-8117-456953536c89 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:11.654227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 660/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Apr 28 13:58:11 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 13:58:13.864716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670f4d-a348-4e45-ac7c-c04919c4b954 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:13.865245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670f4d-a348-4e45-ac7c-c04919c4b954 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:13.865245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670f4d-a348-4e45-ac7c-c04919c4b954 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:13.866664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 636/1296] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:58:13.871768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:13.872197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:13.872321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:13.889248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:58:13.890438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:58:13.958366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 661/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:58:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:58:13.981356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670f4d-a348-4e45-ac7c-c04919c4b954 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:14.075076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670f4d-a348-4e45-ac7c-c04919c4b954 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:14.106693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:14.107480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:14.107761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:14.108034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:14.108678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:14.110076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:14.120755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 28 13:58:14.121892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 637/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:58:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:14.127835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:14.219588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdb6b6-7845-4892-8b7c-62eb634b0c30 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:14.252252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:14.252894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:14.253175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:14.253447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:14.254238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:14.254540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:14.255898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:14.260746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 662/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Apr 28 13:58:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:14.266493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:14.360479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efec76-31f6-4752-a8d9-c2d43e7550a1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:14.391251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:14.391888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:14.392172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:14.392448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:14.393223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] RBAC: Adding query filter params (interface=public, service_id=36468a35b8c849a498be68416a8d055f, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:14.393535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:14.394913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c066e-eb74-461a-a088-fba86167eab8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:14.399667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 638/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Apr 28 13:58:14 2022] GET /identity/v3/endpoints?service_id=36468a35b8c849a498be68416a8d055f&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:14.405741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:14.497878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5503ef-db3b-47f3-b0da-ca9364f4c3d2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:14.529018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b55be-fad3-4e0c-91c5-27c88510dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:14.529693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b55be-fad3-4e0c-91c5-27c88510dbfa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:14.529975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b55be-fad3-4e0c-91c5-27c88510dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:14.530250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b55be-fad3-4e0c-91c5-27c88510dbfa None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:14.530917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b55be-fad3-4e0c-91c5-27c88510dbfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:14.532264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b55be-fad3-4e0c-91c5-27c88510dbfa None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:14.538723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 663/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Apr 28 13:58:14 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 13:58:16.738339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506074a-41ea-4071-b7ac-2a8a89ee9352 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:16.738872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506074a-41ea-4071-b7ac-2a8a89ee9352 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:16.738872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506074a-41ea-4071-b7ac-2a8a89ee9352 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:16.740252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 639/1302] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:58:16.745595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:16.746031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:16.746125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:16.762097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:58:16.763259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:58:16.825358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 664/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:58:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 13:58:16.848697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506074a-41ea-4071-b7ac-2a8a89ee9352 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:16.944128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506074a-41ea-4071-b7ac-2a8a89ee9352 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:16.975837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:16.976611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:16.976892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:16.977165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:16.977833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:16.979183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:16.989898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 28 13:58:16.990971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 640/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Apr 28 13:58:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 13:58:16.996813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:17.101507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb586f5-5cad-4fa9-be07-cf3218180082 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:17.133028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:17.133730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:17.134015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:17.134300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:17.135005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 13:58:17.135316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:17.137179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132b555-e772-4735-8c5e-70e2523a6440 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:17.146065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 665/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Apr 28 13:58:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 13:58:17.152390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:58:17.248358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14302469-7ef6-4ba2-9f70-d34bfda4b3c3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:58:17.280564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467e109-6cb6-4f81-8714-6569819da668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:58:17.281227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467e109-6cb6-4f81-8714-6569819da668 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:58:17.281514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467e109-6cb6-4f81-8714-6569819da668 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:58:17.281824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467e109-6cb6-4f81-8714-6569819da668 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:58:17.282569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467e109-6cb6-4f81-8714-6569819da668 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:58:17.283963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467e109-6cb6-4f81-8714-6569819da668 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:58:17.301916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 641/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Apr 28 13:58:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 13:59:20.735799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb116ba-f74d-44fd-a667-8acc83b5948b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:20.736845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb116ba-f74d-44fd-a667-8acc83b5948b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:20.737364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb116ba-f74d-44fd-a667-8acc83b5948b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:20.742988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 666/1307] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:20.744527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d903-c928-43c1-984f-22c7e288ec35 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:20.744963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d903-c928-43c1-984f-22c7e288ec35 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:20.745051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d903-c928-43c1-984f-22c7e288ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:20.903904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-59c2d903-c928-43c1-984f-22c7e288ec35 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:20.905137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-59c2d903-c928-43c1-984f-22c7e288ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:21.136308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 642/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:21.201124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540755ba-a585-4fb0-8510-3babc1b20fdc None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:21.202099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540755ba-a585-4fb0-8510-3babc1b20fdc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:21.202610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540755ba-a585-4fb0-8510-3babc1b20fdc None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:21.204546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 667/1309] 10.222.0.20 () {54 vars in 964 bytes} [Thu Apr 28 13:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:21.223998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a47c8-6267-40c8-8420-a21e6629ba03 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:21.224647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a47c8-6267-40c8-8420-a21e6629ba03 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:21.225167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a47c8-6267-40c8-8420-a21e6629ba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:21.392691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-df4a47c8-6267-40c8-8420-a21e6629ba03 None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:21.394024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-df4a47c8-6267-40c8-8420-a21e6629ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:21.566876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 643/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Apr 28 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:21.577015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540755ba-a585-4fb0-8510-3babc1b20fdc None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:21.579032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-540755ba-a585-4fb0-8510-3babc1b20fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:21.730859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540755ba-a585-4fb0-8510-3babc1b20fdc None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:21.810686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:21.811548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:21.811938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:21.812370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:21.814198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:21.929293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:21.931219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c25d9-ee9c-40a3-a899-33d132a6a5fe service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:21.950650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 668/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:24.532193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a4a8-cbbb-44ec-bcf7-47568116c436 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:24.532718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a4a8-cbbb-44ec-bcf7-47568116c436 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:24.532718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a4a8-cbbb-44ec-bcf7-47568116c436 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:24.534152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 644/1312] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:24.539562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e28e2-993a-4872-b9db-37c8262d3337 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:24.539960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e28e2-993a-4872-b9db-37c8262d3337 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:24.540203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e28e2-993a-4872-b9db-37c8262d3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:24.615564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c18e28e2-993a-4872-b9db-37c8262d3337 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:24.616772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c18e28e2-993a-4872-b9db-37c8262d3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:24.709423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 669/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:24.747383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a4a8-cbbb-44ec-bcf7-47568116c436 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:24.748930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3236a4a8-cbbb-44ec-bcf7-47568116c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:24.855937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a4a8-cbbb-44ec-bcf7-47568116c436 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:24.927048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:24.927715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:24.928004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:24.928286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:24.930561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:25.036044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:25.037882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b46c-922e-470b-877f-020f6bb7e333 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:25.055743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 645/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:27.625081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3c3d-60f6-459a-a063-9df9f6b08929 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:27.625676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3c3d-60f6-459a-a063-9df9f6b08929 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:27.625676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3c3d-60f6-459a-a063-9df9f6b08929 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:27.627021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 670/1315] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:27.632645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44668062-d8d2-4d9b-b97f-b38834ed4c27 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:27.633069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44668062-d8d2-4d9b-b97f-b38834ed4c27 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:27.633254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44668062-d8d2-4d9b-b97f-b38834ed4c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:27.698038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-44668062-d8d2-4d9b-b97f-b38834ed4c27 None None] MFA Rules not processed for user `a0afa88610e048a686324cd03ba538d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:27.699238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-44668062-d8d2-4d9b-b97f-b38834ed4c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:27.793094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 646/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:27.832918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3c3d-60f6-459a-a063-9df9f6b08929 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:27.835042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-febc3c3d-60f6-459a-a063-9df9f6b08929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:27.933071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3c3d-60f6-459a-a063-9df9f6b08929 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:28.001724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:28.002366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:28.002649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:28.002921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:28.004574 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:28.109149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:28.110621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1a028-a818-4750-928a-c31efc077208 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:28.128210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 671/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:30.876114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad78f2e-f6fe-482f-8aae-eb2c5b8972bd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:30.876592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad78f2e-f6fe-482f-8aae-eb2c5b8972bd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:30.876683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad78f2e-f6fe-482f-8aae-eb2c5b8972bd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:30.878081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 647/1318] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:30.883869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a97e-14b1-4924-a1e2-3612060fdd25 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:30.884275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a97e-14b1-4924-a1e2-3612060fdd25 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:30.884429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a97e-14b1-4924-a1e2-3612060fdd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:30.945603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b054a97e-14b1-4924-a1e2-3612060fdd25 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:30.946786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b054a97e-14b1-4924-a1e2-3612060fdd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:31.036828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 672/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 13:59:31.074878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad78f2e-f6fe-482f-8aae-eb2c5b8972bd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:31.076404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5ad78f2e-f6fe-482f-8aae-eb2c5b8972bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:31.174425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad78f2e-f6fe-482f-8aae-eb2c5b8972bd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:31.241929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:31.242570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:31.242848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:31.243119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:31.244730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:31.345854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:31.347326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294cba-cdcb-4392-bd23-960c31c7f544 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:31.364046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 648/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:34.251410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298210d-2c4c-43d6-afd4-e7dea4df1577 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:34.251930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298210d-2c4c-43d6-afd4-e7dea4df1577 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:34.252047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298210d-2c4c-43d6-afd4-e7dea4df1577 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:34.253583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 673/1321] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:34.259484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319b58-61f3-4f41-9c0c-8c09fe41a5ab None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:34.259932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319b58-61f3-4f41-9c0c-8c09fe41a5ab None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:34.260152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319b58-61f3-4f41-9c0c-8c09fe41a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:34.322358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e6319b58-61f3-4f41-9c0c-8c09fe41a5ab None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:34.323801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e6319b58-61f3-4f41-9c0c-8c09fe41a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:34.414616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 649/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 13:59:34.463578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edcd07-0699-4514-a28a-329e978ae93f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:34.463867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edcd07-0699-4514-a28a-329e978ae93f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:34.464151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edcd07-0699-4514-a28a-329e978ae93f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:34.465538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 674/1323] 10.222.0.20 () {54 vars in 964 bytes} [Thu Apr 28 13:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:34.471334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aedf7-f360-489c-b212-41120c773285 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:34.471622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aedf7-f360-489c-b212-41120c773285 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:34.471900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aedf7-f360-489c-b212-41120c773285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:34.544125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eb7aedf7-f360-489c-b212-41120c773285 None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:34.545322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eb7aedf7-f360-489c-b212-41120c773285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:34.625277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 650/1324] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Apr 28 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 13:59:34.635036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edcd07-0699-4514-a28a-329e978ae93f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:34.636725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-77edcd07-0699-4514-a28a-329e978ae93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:34.736881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edcd07-0699-4514-a28a-329e978ae93f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:34.808661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:34.809313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:34.809619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:34.809894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:34.812117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:34.916629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:34.918091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509fa8f-8cb8-4a37-814b-3bcc1702833a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:34.937057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 675/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:37.475255 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6c535-c778-4a18-b676-cf5a3d7075e2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:37.475827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6c535-c778-4a18-b676-cf5a3d7075e2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:37.475827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6c535-c778-4a18-b676-cf5a3d7075e2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:37.477201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 651/1326] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:37.482435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c950f3-6c59-41a6-bff3-82cadfa02235 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:37.482819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c950f3-6c59-41a6-bff3-82cadfa02235 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:37.482993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c950f3-6c59-41a6-bff3-82cadfa02235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:37.545814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e3c950f3-6c59-41a6-bff3-82cadfa02235 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:37.547006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e3c950f3-6c59-41a6-bff3-82cadfa02235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:37.639070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 676/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:37.675446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6c535-c778-4a18-b676-cf5a3d7075e2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:37.677009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ade6c535-c778-4a18-b676-cf5a3d7075e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:37.781304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6c535-c778-4a18-b676-cf5a3d7075e2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:37.851800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:37.852447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:37.852730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:37.853005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:37.854691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:37.960930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:37.962422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0862425-910e-4573-b93c-6fb2f8c91d74 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:37.980901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 652/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:40.296446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a871-3d42-4c77-a9a1-3f67e07fcac3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:40.296976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a871-3d42-4c77-a9a1-3f67e07fcac3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:40.297206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a871-3d42-4c77-a9a1-3f67e07fcac3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:40.299205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 677/1329] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:40.306416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851730-13af-41c0-b969-a1dd237ebc53 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:40.306827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851730-13af-41c0-b969-a1dd237ebc53 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:40.306976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851730-13af-41c0-b969-a1dd237ebc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:40.369702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cf851730-13af-41c0-b969-a1dd237ebc53 None None] MFA Rules not processed for user `a0afa88610e048a686324cd03ba538d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:40.370823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cf851730-13af-41c0-b969-a1dd237ebc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:40.461689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 653/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:40.498224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a871-3d42-4c77-a9a1-3f67e07fcac3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:40.499728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f169a871-3d42-4c77-a9a1-3f67e07fcac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:40.636515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a871-3d42-4c77-a9a1-3f67e07fcac3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:40.736033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:40.736945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:40.737359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:40.737796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:40.740114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:40.864524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:40.868460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f603428-cfd0-4c8e-83c8-65365cecb054 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:40.895215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 678/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:43.396011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405093b5-26f3-422c-8e32-1c343018c4fc None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:43.397066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405093b5-26f3-422c-8e32-1c343018c4fc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:43.397506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405093b5-26f3-422c-8e32-1c343018c4fc None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:43.400284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 654/1332] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 13:59:43.405654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb938-8f35-427e-996d-b723ad10779f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:43.406205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb938-8f35-427e-996d-b723ad10779f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:43.406205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb938-8f35-427e-996d-b723ad10779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:43.480063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fd8cb938-8f35-427e-996d-b723ad10779f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:43.481366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fd8cb938-8f35-427e-996d-b723ad10779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:43.592714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 679/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:43.637586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405093b5-26f3-422c-8e32-1c343018c4fc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:43.639937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-405093b5-26f3-422c-8e32-1c343018c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:43.763714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405093b5-26f3-422c-8e32-1c343018c4fc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:43.846798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:43.851712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:43.852003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:43.852346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:43.854066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:43.969105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:43.970489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b9580-38df-4b14-8282-db775d16843a service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:43.992533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 655/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 13:59:46.440167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314240-15d1-47a5-90e9-e050315d5d3c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:46.440684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314240-15d1-47a5-90e9-e050315d5d3c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:46.440807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314240-15d1-47a5-90e9-e050315d5d3c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:46.442138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 680/1335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:46.447768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09265-28ea-4505-b40c-7cf536255732 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:46.448150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09265-28ea-4505-b40c-7cf536255732 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:46.448340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09265-28ea-4505-b40c-7cf536255732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:46.511530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-19f09265-28ea-4505-b40c-7cf536255732 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:46.512730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-19f09265-28ea-4505-b40c-7cf536255732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:46.605121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 656/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:46.644836 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314240-15d1-47a5-90e9-e050315d5d3c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:46.646392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f3314240-15d1-47a5-90e9-e050315d5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:46.744018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314240-15d1-47a5-90e9-e050315d5d3c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:46.812737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:46.813378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:46.813688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:46.813973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:46.815604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:46.918202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:46.919620 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda058-fa97-451f-ba4c-47f0ae9dbe7c service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:46.936612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 681/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:49.472974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d2471-b8bc-47ad-84c0-09accfae8781 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:49.473590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d2471-b8bc-47ad-84c0-09accfae8781 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:49.473590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d2471-b8bc-47ad-84c0-09accfae8781 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:49.478374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 657/1338] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:49.480762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca08c96-e638-40b2-806a-b795f03ad6ef None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:49.481165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca08c96-e638-40b2-806a-b795f03ad6ef None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:49.481324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca08c96-e638-40b2-806a-b795f03ad6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:49.544066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cca08c96-e638-40b2-806a-b795f03ad6ef None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:49.545281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cca08c96-e638-40b2-806a-b795f03ad6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:49.636233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 682/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:49.672953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d2471-b8bc-47ad-84c0-09accfae8781 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:49.674567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b32d2471-b8bc-47ad-84c0-09accfae8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:49.772662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d2471-b8bc-47ad-84c0-09accfae8781 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:49.842160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:49.842807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:49.843087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:49.843360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:49.845015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:49.949261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:49.950724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7895856-204c-4407-b52d-f1a07745a432 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:49.967750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 658/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:54.290750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635e4d-6772-49ca-ac4b-0bbbe5818665 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:54.291327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635e4d-6772-49ca-ac4b-0bbbe5818665 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:54.291327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635e4d-6772-49ca-ac4b-0bbbe5818665 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:54.292686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 683/1341] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:54.297926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2231-ad5a-4cff-ac75-79fb70a3369f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:54.298350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2231-ad5a-4cff-ac75-79fb70a3369f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:54.298486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2231-ad5a-4cff-ac75-79fb70a3369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:54.368975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fd0c2231-ad5a-4cff-ac75-79fb70a3369f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:54.370155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fd0c2231-ad5a-4cff-ac75-79fb70a3369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:54.472579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 659/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:54.510639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635e4d-6772-49ca-ac4b-0bbbe5818665 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:54.512746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9f635e4d-6772-49ca-ac4b-0bbbe5818665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:54.604779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635e4d-6772-49ca-ac4b-0bbbe5818665 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:54.608644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773df9-54d9-428b-a9cd-ced50fd9a0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:54.609320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773df9-54d9-428b-a9cd-ced50fd9a0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:54.609629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773df9-54d9-428b-a9cd-ced50fd9a0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:54.609909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773df9-54d9-428b-a9cd-ced50fd9a0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:54.620352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773df9-54d9-428b-a9cd-ced50fd9a0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:54.621752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773df9-54d9-428b-a9cd-ced50fd9a0f4 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:54.631389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 684/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 13:59:57.924796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae846-e926-4005-9442-e8c27118c6b4 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:57.925401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae846-e926-4005-9442-e8c27118c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:57.925401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae846-e926-4005-9442-e8c27118c6b4 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:57.927327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 660/1344] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 13:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 13:59:57.932659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f939e05-c15b-49bb-b6dd-6d1bd51cf993 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:57.933094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f939e05-c15b-49bb-b6dd-6d1bd51cf993 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:57.933205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f939e05-c15b-49bb-b6dd-6d1bd51cf993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:57.960369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4f939e05-c15b-49bb-b6dd-6d1bd51cf993 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 13:59:57.961581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4f939e05-c15b-49bb-b6dd-6d1bd51cf993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 13:59:58.035199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 685/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 13:59:58.072371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ae846-e926-4005-9442-e8c27118c6b4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 13:59:58.083277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ae846-e926-4005-9442-e8c27118c6b4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 13:59:58.086781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345624-ef66-4279-9287-0cb2bb64043c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 13:59:58.087478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345624-ef66-4279-9287-0cb2bb64043c service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 13:59:58.087845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345624-ef66-4279-9287-0cb2bb64043c service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 13:59:58.088192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345624-ef66-4279-9287-0cb2bb64043c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 13:59:58.097095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345624-ef66-4279-9287-0cb2bb64043c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 13:59:58.099167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345624-ef66-4279-9287-0cb2bb64043c service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 13:59:58.108654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 661/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:02.612074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1684-1e40-44fa-9587-5196b65c3eac None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:02.612632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1684-1e40-44fa-9587-5196b65c3eac None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:02.612632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1684-1e40-44fa-9587-5196b65c3eac None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:02.614181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 686/1347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:02.619354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d4b3f-69c3-4c9e-9c36-c667af8837de None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:02.619788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d4b3f-69c3-4c9e-9c36-c667af8837de None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:02.620033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d4b3f-69c3-4c9e-9c36-c667af8837de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:02.638255 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-904d4b3f-69c3-4c9e-9c36-c667af8837de None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:02.639817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-904d4b3f-69c3-4c9e-9c36-c667af8837de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:02.649340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 662/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:02.687022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1684-1e40-44fa-9587-5196b65c3eac None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:02.698062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1684-1e40-44fa-9587-5196b65c3eac None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:02.701461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb2db-d8c2-4794-8091-31b51e64b054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:02.702197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb2db-d8c2-4794-8091-31b51e64b054 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:02.702505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb2db-d8c2-4794-8091-31b51e64b054 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:02.702773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb2db-d8c2-4794-8091-31b51e64b054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:02.711782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb2db-d8c2-4794-8091-31b51e64b054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:02.713220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb2db-d8c2-4794-8091-31b51e64b054 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:02.722556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 687/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:08.031789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b6f2b-fcb9-487b-b607-28863d536e12 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:08.032290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b6f2b-fcb9-487b-b607-28863d536e12 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:08.032396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b6f2b-fcb9-487b-b607-28863d536e12 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:08.033750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 663/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:08.039310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aede4-7277-4085-964d-ed3bc53ff1eb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:08.039749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aede4-7277-4085-964d-ed3bc53ff1eb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:08.039885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aede4-7277-4085-964d-ed3bc53ff1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:08.112010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1c8aede4-7277-4085-964d-ed3bc53ff1eb None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:08.113471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1c8aede4-7277-4085-964d-ed3bc53ff1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:08.198115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 688/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:00:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:12.660660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8ada-13a5-46b3-b1bf-40626b3bac7d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:12.661186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8ada-13a5-46b3-b1bf-40626b3bac7d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:12.661300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8ada-13a5-46b3-b1bf-40626b3bac7d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:12.663163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 664/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:00:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:12.668754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9648ea-2619-4f00-84cc-2532e01f4429 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:12.669272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9648ea-2619-4f00-84cc-2532e01f4429 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:12.669376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9648ea-2619-4f00-84cc-2532e01f4429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:12.693747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fd9648ea-2619-4f00-84cc-2532e01f4429 None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:12.694976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fd9648ea-2619-4f00-84cc-2532e01f4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:12.704163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 689/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:00:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:14.046306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831e51-fa40-4d51-9d61-796e82cbd18c None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:14.046851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831e51-fa40-4d51-9d61-796e82cbd18c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:14.046963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831e51-fa40-4d51-9d61-796e82cbd18c None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:14.048464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 665/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:14.056183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222bfa0-c59f-4383-a3d7-11105b5ecc5e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:14.056664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222bfa0-c59f-4383-a3d7-11105b5ecc5e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:14.056746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222bfa0-c59f-4383-a3d7-11105b5ecc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:14.075356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0222bfa0-c59f-4383-a3d7-11105b5ecc5e None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:14.076636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0222bfa0-c59f-4383-a3d7-11105b5ecc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:14.086058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 690/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:17.982113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74234-cfb7-4271-8962-f28916ba6c07 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:17.982690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74234-cfb7-4271-8962-f28916ba6c07 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:17.982690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74234-cfb7-4271-8962-f28916ba6c07 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:17.988426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 666/1356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:17.991330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515bcb-b69b-4279-84ca-49869a614b6c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:17.991755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515bcb-b69b-4279-84ca-49869a614b6c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:17.992061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515bcb-b69b-4279-84ca-49869a614b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:18.020247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-86515bcb-b69b-4279-84ca-49869a614b6c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:18.024558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-86515bcb-b69b-4279-84ca-49869a614b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:18.036517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 691/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:18.082147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471cd9d-d311-402d-80c2-29e57294cddb None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:18.082677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471cd9d-d311-402d-80c2-29e57294cddb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:18.083163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471cd9d-d311-402d-80c2-29e57294cddb None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:18.084964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 667/1358] 10.222.0.20 () {54 vars in 960 bytes} [Thu Apr 28 14:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:18.090931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad6d2-7583-462f-b41d-5e5db05c9bbe None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:18.091224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad6d2-7583-462f-b41d-5e5db05c9bbe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:18.091507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad6d2-7583-462f-b41d-5e5db05c9bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:18.157689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ac3ad6d2-7583-462f-b41d-5e5db05c9bbe None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:18.159227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ac3ad6d2-7583-462f-b41d-5e5db05c9bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:18.253409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 692/1359] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Apr 28 14:00:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:18.254206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471cd9d-d311-402d-80c2-29e57294cddb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:18.295702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471cd9d-d311-402d-80c2-29e57294cddb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:18.305138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed1ec8-9606-4740-959f-51e9b34f2486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:18.306014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed1ec8-9606-4740-959f-51e9b34f2486 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:18.306598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed1ec8-9606-4740-959f-51e9b34f2486 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:18.306971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed1ec8-9606-4740-959f-51e9b34f2486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:18.316061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed1ec8-9606-4740-959f-51e9b34f2486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:18.317986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed1ec8-9606-4740-959f-51e9b34f2486 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:18.327849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 668/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:20.804797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ca20-6aeb-4378-89db-7c311444b703 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:20.805302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ca20-6aeb-4378-89db-7c311444b703 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:20.805412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ca20-6aeb-4378-89db-7c311444b703 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:20.807305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 693/1361] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:20.812827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0899a4-186c-4b22-9c67-802cadf0489e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:20.813273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0899a4-186c-4b22-9c67-802cadf0489e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:20.813406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0899a4-186c-4b22-9c67-802cadf0489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:20.831706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1f0899a4-186c-4b22-9c67-802cadf0489e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:20.832759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1f0899a4-186c-4b22-9c67-802cadf0489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:20.841066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 669/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:20.889955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11ca20-6aeb-4378-89db-7c311444b703 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:20.904699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11ca20-6aeb-4378-89db-7c311444b703 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:20.911415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f2342-39ce-44fa-8044-9e63ee92b995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:20.912291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2342-39ce-44fa-8044-9e63ee92b995 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:20.912848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2342-39ce-44fa-8044-9e63ee92b995 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:20.913403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2342-39ce-44fa-8044-9e63ee92b995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:20.922081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f2342-39ce-44fa-8044-9e63ee92b995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:20.924095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f2342-39ce-44fa-8044-9e63ee92b995 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:20.934378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 694/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:23.539409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e75024-3425-43ec-8056-566d593cbbd2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:23.539901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e75024-3425-43ec-8056-566d593cbbd2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:23.539979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e75024-3425-43ec-8056-566d593cbbd2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:23.541432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 670/1364] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:00:23.547415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9bd8-bf95-462c-a84f-1455fd26af7e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:23.547827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9bd8-bf95-462c-a84f-1455fd26af7e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:23.548109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9bd8-bf95-462c-a84f-1455fd26af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:23.570752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c21d9bd8-bf95-462c-a84f-1455fd26af7e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:23.572297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c21d9bd8-bf95-462c-a84f-1455fd26af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:23.581538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 695/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:23.634032 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98fdcf-35fa-4e74-b4d2-c36abf726dda None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:23.634340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98fdcf-35fa-4e74-b4d2-c36abf726dda None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:23.634682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98fdcf-35fa-4e74-b4d2-c36abf726dda None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:23.636310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 671/1366] 10.222.0.20 () {54 vars in 960 bytes} [Thu Apr 28 14:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:23.642430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f60d6-68ff-43aa-b554-984b519951a7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:23.643115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f60d6-68ff-43aa-b554-984b519951a7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:23.643572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f60d6-68ff-43aa-b554-984b519951a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:23.662467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8e2f60d6-68ff-43aa-b554-984b519951a7 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:23.663644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8e2f60d6-68ff-43aa-b554-984b519951a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:23.673021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 696/1367] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Apr 28 14:00:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:00:23.684087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98fdcf-35fa-4e74-b4d2-c36abf726dda None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:23.698312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98fdcf-35fa-4e74-b4d2-c36abf726dda None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:23.704159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119ed99-5a5a-4f54-8c54-9172f9080978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:23.704895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119ed99-5a5a-4f54-8c54-9172f9080978 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:23.705244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119ed99-5a5a-4f54-8c54-9172f9080978 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:23.705618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119ed99-5a5a-4f54-8c54-9172f9080978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:23.713996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119ed99-5a5a-4f54-8c54-9172f9080978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:23.715699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119ed99-5a5a-4f54-8c54-9172f9080978 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:23.725836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 672/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:26.057860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b0299-d74b-4846-948a-ce9bf1b893a0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.059959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b0299-d74b-4846-948a-ce9bf1b893a0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.059959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b0299-d74b-4846-948a-ce9bf1b893a0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.060851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 697/1369] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:26.066893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f97a-755b-47e4-ad62-90dd271137e1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.067451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f97a-755b-47e4-ad62-90dd271137e1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.067451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f97a-755b-47e4-ad62-90dd271137e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.089140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7c54f97a-755b-47e4-ad62-90dd271137e1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:26.091125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7c54f97a-755b-47e4-ad62-90dd271137e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:26.102411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 673/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:26.147151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b0299-d74b-4846-948a-ce9bf1b893a0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:26.162130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b0299-d74b-4846-948a-ce9bf1b893a0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:26.167596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161408ec-e813-49ee-bfd3-334c6a77bba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:26.168242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161408ec-e813-49ee-bfd3-334c6a77bba0 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.168525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161408ec-e813-49ee-bfd3-334c6a77bba0 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.168799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161408ec-e813-49ee-bfd3-334c6a77bba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.177347 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161408ec-e813-49ee-bfd3-334c6a77bba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:26.178957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161408ec-e813-49ee-bfd3-334c6a77bba0 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:26.189222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 698/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:26.245003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655be1-7bea-4c9c-8b52-29a3c5666aa7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.245291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655be1-7bea-4c9c-8b52-29a3c5666aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.245819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655be1-7bea-4c9c-8b52-29a3c5666aa7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.247555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 674/1372] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:26.253512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9f06-3df1-404c-8b9a-b07d3da76a59 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.253832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9f06-3df1-404c-8b9a-b07d3da76a59 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.254318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9f06-3df1-404c-8b9a-b07d3da76a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.275250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0e1b9f06-3df1-404c-8b9a-b07d3da76a59 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:26.276833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0e1b9f06-3df1-404c-8b9a-b07d3da76a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:26.286819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 699/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:26.601981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191cac7-784f-4dca-a5ea-4035fae3cf8b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.601981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191cac7-784f-4dca-a5ea-4035fae3cf8b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.601981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191cac7-784f-4dca-a5ea-4035fae3cf8b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.601981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 675/1374] 10.222.0.20 () {54 vars in 962 bytes} [Thu Apr 28 14:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:26.606081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d79d-6402-48fb-97da-9311558a63d6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.606081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d79d-6402-48fb-97da-9311558a63d6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.606390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d79d-6402-48fb-97da-9311558a63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.658022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1f99d79d-6402-48fb-97da-9311558a63d6 None None] MFA Rules not processed for user `9e91a0ab4e4c4f4d96f357e7770a011a`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:26.659302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1f99d79d-6402-48fb-97da-9311558a63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:26.725664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 700/1375] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Apr 28 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:00:26.733987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191cac7-784f-4dca-a5ea-4035fae3cf8b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:26.744549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191cac7-784f-4dca-a5ea-4035fae3cf8b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:26.748189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e0e95-c379-405a-bbbc-93ab3854eea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:26.748824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e0e95-c379-405a-bbbc-93ab3854eea4 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:26.749110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e0e95-c379-405a-bbbc-93ab3854eea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:26.749606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e0e95-c379-405a-bbbc-93ab3854eea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:26.759226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e0e95-c379-405a-bbbc-93ab3854eea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:26.760835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e0e95-c379-405a-bbbc-93ab3854eea4 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:26.770762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 676/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:28.512410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a306809-9db7-4645-aab5-b4ad20fba583 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:28.512966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a306809-9db7-4645-aab5-b4ad20fba583 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:28.512966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a306809-9db7-4645-aab5-b4ad20fba583 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:28.514361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 701/1377] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:28.520121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165ba7d-34fc-434a-a38b-11db1d8583a9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:28.520559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165ba7d-34fc-434a-a38b-11db1d8583a9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:28.520666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165ba7d-34fc-434a-a38b-11db1d8583a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:28.538847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e165ba7d-34fc-434a-a38b-11db1d8583a9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:28.540056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e165ba7d-34fc-434a-a38b-11db1d8583a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:28.548265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 677/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:28.591906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a306809-9db7-4645-aab5-b4ad20fba583 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:28.606799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a306809-9db7-4645-aab5-b4ad20fba583 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:28.612285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5d5b2-0587-44ad-a5ec-57985ead9e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:28.612924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5d5b2-0587-44ad-a5ec-57985ead9e79 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:28.613210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5d5b2-0587-44ad-a5ec-57985ead9e79 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:28.613484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5d5b2-0587-44ad-a5ec-57985ead9e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:28.622380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5d5b2-0587-44ad-a5ec-57985ead9e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:28.623960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5d5b2-0587-44ad-a5ec-57985ead9e79 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:28.633255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 702/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:31.238328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a26fc-8286-4ccf-80d9-a19b32ef1144 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:31.238885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a26fc-8286-4ccf-80d9-a19b32ef1144 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:31.238885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a26fc-8286-4ccf-80d9-a19b32ef1144 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:31.240261 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 678/1380] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:31.245456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3646b-69f4-4c9b-b058-6461e78a14a7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:31.245870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3646b-69f4-4c9b-b058-6461e78a14a7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:31.246052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3646b-69f4-4c9b-b058-6461e78a14a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:31.264215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b6c3646b-69f4-4c9b-b058-6461e78a14a7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:31.265401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b6c3646b-69f4-4c9b-b058-6461e78a14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:31.273933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 703/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:31.319100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a26fc-8286-4ccf-80d9-a19b32ef1144 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:31.338641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a26fc-8286-4ccf-80d9-a19b32ef1144 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:31.349693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f23e0-8829-490f-a262-aeb0ca74116a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:31.350621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f23e0-8829-490f-a262-aeb0ca74116a service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:31.351045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f23e0-8829-490f-a262-aeb0ca74116a service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:31.351405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f23e0-8829-490f-a262-aeb0ca74116a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:31.365183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f23e0-8829-490f-a262-aeb0ca74116a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:31.367567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f23e0-8829-490f-a262-aeb0ca74116a service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:31.381871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 679/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:33.670885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11c2e-e6c4-45e2-ba3a-34dac4154d95 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:33.671326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11c2e-e6c4-45e2-ba3a-34dac4154d95 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:33.671443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11c2e-e6c4-45e2-ba3a-34dac4154d95 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:33.676007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 704/1383] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:33.678513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105499-56da-4818-bd3d-7c41f3e7a3a7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:33.679417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105499-56da-4818-bd3d-7c41f3e7a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:33.679739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105499-56da-4818-bd3d-7c41f3e7a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:33.698210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-86105499-56da-4818-bd3d-7c41f3e7a3a7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:33.699642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-86105499-56da-4818-bd3d-7c41f3e7a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:33.708337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 680/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:33.750756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad11c2e-e6c4-45e2-ba3a-34dac4154d95 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:33.765175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad11c2e-e6c4-45e2-ba3a-34dac4154d95 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:33.772278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8419b61-41b3-4eb8-bf61-1e750f6242cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:33.772995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8419b61-41b3-4eb8-bf61-1e750f6242cb service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:33.773343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8419b61-41b3-4eb8-bf61-1e750f6242cb service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:33.773718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8419b61-41b3-4eb8-bf61-1e750f6242cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:33.782238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8419b61-41b3-4eb8-bf61-1e750f6242cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:33.783913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8419b61-41b3-4eb8-bf61-1e750f6242cb service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:33.794206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 705/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:36.129735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656964-4117-4cca-8a0c-2b1f7c4ad7e7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:36.130262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656964-4117-4cca-8a0c-2b1f7c4ad7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:36.130358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656964-4117-4cca-8a0c-2b1f7c4ad7e7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:36.131678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 681/1386] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:36.137007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a8fb-d375-4832-83ad-e13c5834e0bc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:36.137430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a8fb-d375-4832-83ad-e13c5834e0bc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:36.137818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a8fb-d375-4832-83ad-e13c5834e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:36.156279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6354a8fb-d375-4832-83ad-e13c5834e0bc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:36.157474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6354a8fb-d375-4832-83ad-e13c5834e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:36.166396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 706/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:36.210907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d656964-4117-4cca-8a0c-2b1f7c4ad7e7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:36.225997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d656964-4117-4cca-8a0c-2b1f7c4ad7e7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:36.231462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de3268-0406-451f-88e6-85d3b8c11cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:36.232116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3268-0406-451f-88e6-85d3b8c11cb9 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:36.232397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3268-0406-451f-88e6-85d3b8c11cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:36.232675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3268-0406-451f-88e6-85d3b8c11cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:36.243415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de3268-0406-451f-88e6-85d3b8c11cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:36.245032 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de3268-0406-451f-88e6-85d3b8c11cb9 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:36.254714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 682/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:38.527366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0693fc8-5f8a-42a1-b4ae-375bd4ac5fe2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:38.528059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0693fc8-5f8a-42a1-b4ae-375bd4ac5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:38.528059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0693fc8-5f8a-42a1-b4ae-375bd4ac5fe2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:38.530389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 707/1389] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:38.536798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118fcfe-9dde-4abd-a779-bf0792941669 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:38.537348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118fcfe-9dde-4abd-a779-bf0792941669 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:38.537348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118fcfe-9dde-4abd-a779-bf0792941669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:38.556156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0118fcfe-9dde-4abd-a779-bf0792941669 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:38.557395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0118fcfe-9dde-4abd-a779-bf0792941669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:38.565393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 683/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:38.612434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0693fc8-5f8a-42a1-b4ae-375bd4ac5fe2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:38.626957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0693fc8-5f8a-42a1-b4ae-375bd4ac5fe2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:38.632979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6277-1d6a-49d1-9d9b-4fb981c134c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:38.633640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6277-1d6a-49d1-9d9b-4fb981c134c0 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:38.633921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6277-1d6a-49d1-9d9b-4fb981c134c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:38.634192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6277-1d6a-49d1-9d9b-4fb981c134c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:38.642735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc6277-1d6a-49d1-9d9b-4fb981c134c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:38.645373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc6277-1d6a-49d1-9d9b-4fb981c134c0 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:38.655140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 708/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:40.928776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932493-ff01-4f7c-b798-a32b0d56b7fd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:40.929395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932493-ff01-4f7c-b798-a32b0d56b7fd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:40.929395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932493-ff01-4f7c-b798-a32b0d56b7fd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:40.930716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 684/1392] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:40.935912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb077e9-0fba-464b-863c-0599e2d804c7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:40.936395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb077e9-0fba-464b-863c-0599e2d804c7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:40.936500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb077e9-0fba-464b-863c-0599e2d804c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:40.954479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3bb077e9-0fba-464b-863c-0599e2d804c7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:40.955670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3bb077e9-0fba-464b-863c-0599e2d804c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:40.968496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 709/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:00:41.012229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99932493-ff01-4f7c-b798-a32b0d56b7fd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:41.027128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99932493-ff01-4f7c-b798-a32b0d56b7fd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:41.032587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8496df-4694-4575-9b95-0ba028b61565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:41.033224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8496df-4694-4575-9b95-0ba028b61565 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:41.033509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8496df-4694-4575-9b95-0ba028b61565 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:41.033829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8496df-4694-4575-9b95-0ba028b61565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:41.042290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8496df-4694-4575-9b95-0ba028b61565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:41.043893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8496df-4694-4575-9b95-0ba028b61565 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:41.053594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 685/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:42.532239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6494-a70c-420a-8a07-0e1d25eb5643 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:42.532812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6494-a70c-420a-8a07-0e1d25eb5643 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:42.532812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6494-a70c-420a-8a07-0e1d25eb5643 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:42.534211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 710/1395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:42.539709 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3837-4a46-449c-9f29-4800977c843b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:42.540141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3837-4a46-449c-9f29-4800977c843b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:42.540304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3837-4a46-449c-9f29-4800977c843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:42.557861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-31ac3837-4a46-449c-9f29-4800977c843b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:42.559052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-31ac3837-4a46-449c-9f29-4800977c843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:42.567341 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 686/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:42.622302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830e31-facd-4493-94f7-cd8f4c45a8a1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:42.622589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830e31-facd-4493-94f7-cd8f4c45a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:42.622866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830e31-facd-4493-94f7-cd8f4c45a8a1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:42.624237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 711/1397] 10.222.0.20 () {54 vars in 962 bytes} [Thu Apr 28 14:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:42.630036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560bb9d-4bd7-4963-859c-2c1e3084360c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:42.630326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560bb9d-4bd7-4963-859c-2c1e3084360c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:42.630598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560bb9d-4bd7-4963-859c-2c1e3084360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:42.677265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8560bb9d-4bd7-4963-859c-2c1e3084360c None None] MFA Rules not processed for user `562f710be70f4e11a67dc65b1adb5c89`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:42.678503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8560bb9d-4bd7-4963-859c-2c1e3084360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:42.736371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 687/1398] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Apr 28 14:00:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:42.744338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78830e31-facd-4493-94f7-cd8f4c45a8a1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:42.756109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78830e31-facd-4493-94f7-cd8f4c45a8a1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:42.759722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc209b7-17de-4b21-b1ef-f08b74f165f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:42.760419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc209b7-17de-4b21-b1ef-f08b74f165f1 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:42.760628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc209b7-17de-4b21-b1ef-f08b74f165f1 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:42.760901 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc209b7-17de-4b21-b1ef-f08b74f165f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:42.771371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc209b7-17de-4b21-b1ef-f08b74f165f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:42.773371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc209b7-17de-4b21-b1ef-f08b74f165f1 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:42.784895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 712/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:00:43.251348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d0615-8000-4b5c-8722-62f74abcf728 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.251670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d0615-8000-4b5c-8722-62f74abcf728 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.251980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d0615-8000-4b5c-8722-62f74abcf728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.303881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5d7d0615-8000-4b5c-8722-62f74abcf728 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:43.305105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5d7d0615-8000-4b5c-8722-62f74abcf728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:43.368067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 688/1400] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:43.423169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7d24-7b3f-45d7-977c-abeab9ad5b54 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.423459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7d24-7b3f-45d7-977c-abeab9ad5b54 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.423737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7d24-7b3f-45d7-977c-abeab9ad5b54 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.425136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 713/1401] 10.222.0.20 () {54 vars in 942 bytes} [Thu Apr 28 14:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:43.432511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.432811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.433132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.447794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e27a1-a412-405b-a27b-e18022372fe6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.448254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e27a1-a412-405b-a27b-e18022372fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.448697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e27a1-a412-405b-a27b-e18022372fe6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.450305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 714/1402] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:00:43.455659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.455943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.456220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.473934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:43.475125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:43.482808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 715/1403] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:00:43.482943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] MFA Rules not processed for user `ce69ab30e4eb4a46945a5420d85ec611`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:43.484117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:43.527306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:43.539957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee451-e263-4ba1-a56c-fb73053730c8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:43.545355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f068f-d228-4913-ad66-18b40b214bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:43.546020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f068f-d228-4913-ad66-18b40b214bbf service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.546311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f068f-d228-4913-ad66-18b40b214bbf service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.546587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f068f-d228-4913-ad66-18b40b214bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.554660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f068f-d228-4913-ad66-18b40b214bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:43.555467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 689/1404] 10.222.0.20 () {58 vars in 1039 bytes} [Thu Apr 28 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:43.556252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f068f-d228-4913-ad66-18b40b214bbf service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:43.564838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:43.566024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 716/1405] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:00:43.574537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a588f4-8ec4-4c83-8a36-af11b22736ba None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:43.579613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a70f0-66ac-48c4-8c45-1e59fd3c4996 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:43.580396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a70f0-66ac-48c4-8c45-1e59fd3c4996 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:43.580676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a70f0-66ac-48c4-8c45-1e59fd3c4996 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:43.580949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a70f0-66ac-48c4-8c45-1e59fd3c4996 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:43.589646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a70f0-66ac-48c4-8c45-1e59fd3c4996 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:43.591214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a70f0-66ac-48c4-8c45-1e59fd3c4996 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:43.600070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 690/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 14:00:45.919327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b488-7e57-47b9-875b-7947729f88f8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:45.919875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b488-7e57-47b9-875b-7947729f88f8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:45.919875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b488-7e57-47b9-875b-7947729f88f8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:45.921265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 717/1407] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:00:45.927309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f8fd5-ca08-4f35-85de-5892f8622747 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:45.927745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f8fd5-ca08-4f35-85de-5892f8622747 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:45.927856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f8fd5-ca08-4f35-85de-5892f8622747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:45.945684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d77f8fd5-ca08-4f35-85de-5892f8622747 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:00:45.946888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d77f8fd5-ca08-4f35-85de-5892f8622747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:00:45.955274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 691/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:00:45.998506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b488-7e57-47b9-875b-7947729f88f8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:00:46.013314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b488-7e57-47b9-875b-7947729f88f8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:00:46.018815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9454c3-2076-4fd5-a771-e8c943dd3f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:00:46.019470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9454c3-2076-4fd5-a771-e8c943dd3f95 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:00:46.019747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9454c3-2076-4fd5-a771-e8c943dd3f95 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:00:46.020018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9454c3-2076-4fd5-a771-e8c943dd3f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:00:46.028374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9454c3-2076-4fd5-a771-e8c943dd3f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:00:46.030017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9454c3-2076-4fd5-a771-e8c943dd3f95 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:00:46.040362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 718/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:07.030035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364548e3-854e-4da6-85e1-1453600d78aa None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:07.030648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364548e3-854e-4da6-85e1-1453600d78aa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:07.030648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364548e3-854e-4da6-85e1-1453600d78aa None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:07.031974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 692/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Apr 28 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:07.038029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c145-4cf1-4212-a030-f2a2183bbe92 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:07.038504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c145-4cf1-4212-a030-f2a2183bbe92 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:07.038612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c145-4cf1-4212-a030-f2a2183bbe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:07.056469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9e49c145-4cf1-4212-a030-f2a2183bbe92 None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:07.057736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9e49c145-4cf1-4212-a030-f2a2183bbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:07.066520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 719/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Apr 28 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:07.082690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609d75-85c0-4b2e-a53f-ff9fe7068b71 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:07.082983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609d75-85c0-4b2e-a53f-ff9fe7068b71 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:07.083266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609d75-85c0-4b2e-a53f-ff9fe7068b71 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:07.084620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 693/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Apr 28 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:07.089044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9ab4b-9b8f-4a0b-b9a5-8cd067d8fac1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:07.089338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9ab4b-9b8f-4a0b-b9a5-8cd067d8fac1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:07.089653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9ab4b-9b8f-4a0b-b9a5-8cd067d8fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:07.107907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-90a9ab4b-9b8f-4a0b-b9a5-8cd067d8fac1 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:07.109077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-90a9ab4b-9b8f-4a0b-b9a5-8cd067d8fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:07.118059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 720/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Apr 28 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:09.812376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c17e-ab31-4d5d-8dd1-d8f9eab3a387 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:09.812943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c17e-ab31-4d5d-8dd1-d8f9eab3a387 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:09.812943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c17e-ab31-4d5d-8dd1-d8f9eab3a387 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:09.814319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:09.819486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364036-bd66-4179-8954-f2941791d990 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:09.819944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364036-bd66-4179-8954-f2941791d990 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:09.820044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364036-bd66-4179-8954-f2941791d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:09.837404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ee364036-bd66-4179-8954-f2941791d990 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:09.838590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ee364036-bd66-4179-8954-f2941791d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:09.846219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:01:09.887357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c17e-ab31-4d5d-8dd1-d8f9eab3a387 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:09.901703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c17e-ab31-4d5d-8dd1-d8f9eab3a387 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:09.906999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5f3d-3a9c-43c8-8ec6-acab0c484e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:09.907628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5f3d-3a9c-43c8-8ec6-acab0c484e68 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:09.907907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5f3d-3a9c-43c8-8ec6-acab0c484e68 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:09.908181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5f3d-3a9c-43c8-8ec6-acab0c484e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:09.916814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5f3d-3a9c-43c8-8ec6-acab0c484e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:09.918426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5f3d-3a9c-43c8-8ec6-acab0c484e68 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:09.927456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 695/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:11.211630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f26da-4123-44cc-8715-a5e6d7c915c4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:11.212156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f26da-4123-44cc-8715-a5e6d7c915c4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:11.212156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f26da-4123-44cc-8715-a5e6d7c915c4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:11.213462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:11.218351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34fc7-01b0-4068-96aa-119e5ce53ba1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:11.218755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34fc7-01b0-4068-96aa-119e5ce53ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:11.218938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34fc7-01b0-4068-96aa-119e5ce53ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:11.238589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-77b34fc7-01b0-4068-96aa-119e5ce53ba1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:11.239786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-77b34fc7-01b0-4068-96aa-119e5ce53ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:11.247542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:11.423370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f26da-4123-44cc-8715-a5e6d7c915c4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:11.437870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f26da-4123-44cc-8715-a5e6d7c915c4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:11.443812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a566a-cd10-47fd-8463-2fa8982c36ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:11.444437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a566a-cd10-47fd-8463-2fa8982c36ef service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:11.444720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a566a-cd10-47fd-8463-2fa8982c36ef service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:11.444995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a566a-cd10-47fd-8463-2fa8982c36ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:11.452769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a566a-cd10-47fd-8463-2fa8982c36ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:11.454377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a566a-cd10-47fd-8463-2fa8982c36ef service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:11.463492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 723/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:12.717463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74004-b790-4a51-a90c-277475262181 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:12.718035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74004-b790-4a51-a90c-277475262181 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:12.718158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74004-b790-4a51-a90c-277475262181 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:12.719489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:12.724987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f201571-f793-4772-80da-58f1e5df2e79 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:12.725420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f201571-f793-4772-80da-58f1e5df2e79 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:12.725527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f201571-f793-4772-80da-58f1e5df2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:12.743555 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4f201571-f793-4772-80da-58f1e5df2e79 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:12.744736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4f201571-f793-4772-80da-58f1e5df2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:12.752355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:12.899505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c74004-b790-4a51-a90c-277475262181 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:12.914376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c74004-b790-4a51-a90c-277475262181 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:12.919591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdac4b-d9a1-4e53-80ed-2ef0abb531f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:12.920218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdac4b-d9a1-4e53-80ed-2ef0abb531f2 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:12.920496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdac4b-d9a1-4e53-80ed-2ef0abb531f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:12.920766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdac4b-d9a1-4e53-80ed-2ef0abb531f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:12.928535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdac4b-d9a1-4e53-80ed-2ef0abb531f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:12.930139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdac4b-d9a1-4e53-80ed-2ef0abb531f2 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:12.939071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 698/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:14.192208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f160-1d02-4afb-be21-965a7cb45fba None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:14.192745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f160-1d02-4afb-be21-965a7cb45fba None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:14.192745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f160-1d02-4afb-be21-965a7cb45fba None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:14.194179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:14.199115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9a58-b045-4b55-b03d-7c83baefd65e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:14.199538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9a58-b045-4b55-b03d-7c83baefd65e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:14.199684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9a58-b045-4b55-b03d-7c83baefd65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:14.217030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2feb9a58-b045-4b55-b03d-7c83baefd65e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:14.218254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2feb9a58-b045-4b55-b03d-7c83baefd65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:14.226652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:14.375693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f160-1d02-4afb-be21-965a7cb45fba None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:14.389390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f160-1d02-4afb-be21-965a7cb45fba None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:14.395130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6a8c9-121a-40e7-8722-9c138b8a26fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:14.395749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a8c9-121a-40e7-8722-9c138b8a26fc service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:14.396026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a8c9-121a-40e7-8722-9c138b8a26fc service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:14.396296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a8c9-121a-40e7-8722-9c138b8a26fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:14.404223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6a8c9-121a-40e7-8722-9c138b8a26fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:14.405862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6a8c9-121a-40e7-8722-9c138b8a26fc service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:14.415986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 726/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:15.651522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18bb1-b510-45d8-a1d7-d6bdac2d5bbc None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:15.652092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18bb1-b510-45d8-a1d7-d6bdac2d5bbc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:15.652092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18bb1-b510-45d8-a1d7-d6bdac2d5bbc None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:15.653436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:01:15.658323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318d70-b562-418b-9e72-61174aa1ec22 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:15.658706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318d70-b562-418b-9e72-61174aa1ec22 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:15.658913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318d70-b562-418b-9e72-61174aa1ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:15.677473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-08318d70-b562-418b-9e72-61174aa1ec22 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:15.678708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-08318d70-b562-418b-9e72-61174aa1ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:15.686504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:15.832899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18bb1-b510-45d8-a1d7-d6bdac2d5bbc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:15.846536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18bb1-b510-45d8-a1d7-d6bdac2d5bbc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:15.852283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78cdf0-be60-4cd9-8282-b273b2d36ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:15.852902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78cdf0-be60-4cd9-8282-b273b2d36ff6 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:15.853180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78cdf0-be60-4cd9-8282-b273b2d36ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:15.853449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78cdf0-be60-4cd9-8282-b273b2d36ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:15.861166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78cdf0-be60-4cd9-8282-b273b2d36ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:15.862814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78cdf0-be60-4cd9-8282-b273b2d36ff6 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:15.871771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 701/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:01:17.059788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bfae-4546-4418-b3c3-07053174f6e5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:17.060346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bfae-4546-4418-b3c3-07053174f6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:17.060346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bfae-4546-4418-b3c3-07053174f6e5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:17.061770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:17.067193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3855-32e8-4550-aaf8-61a3fc93fd62 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:17.067774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3855-32e8-4550-aaf8-61a3fc93fd62 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:17.068079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3855-32e8-4550-aaf8-61a3fc93fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:17.086031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3efa3855-32e8-4550-aaf8-61a3fc93fd62 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:17.087212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3efa3855-32e8-4550-aaf8-61a3fc93fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:17.095172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:17.243239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bfae-4546-4418-b3c3-07053174f6e5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:17.258001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bfae-4546-4418-b3c3-07053174f6e5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:17.263300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6952b8f-c1cf-45cc-9991-f156de046d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:17.263934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6952b8f-c1cf-45cc-9991-f156de046d4a service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:17.264215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6952b8f-c1cf-45cc-9991-f156de046d4a service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:17.264485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6952b8f-c1cf-45cc-9991-f156de046d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:17.272465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6952b8f-c1cf-45cc-9991-f156de046d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:17.274053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6952b8f-c1cf-45cc-9991-f156de046d4a service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:17.283034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 729/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:18.498534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7817-f550-451c-bd73-8d9480e09995 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:18.499089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7817-f550-451c-bd73-8d9480e09995 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:18.499089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7817-f550-451c-bd73-8d9480e09995 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:18.500438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:18.506087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eb416-0bde-4e37-bf15-76c5b45bf59b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:18.506522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eb416-0bde-4e37-bf15-76c5b45bf59b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:18.506643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eb416-0bde-4e37-bf15-76c5b45bf59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:18.524849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-247eb416-0bde-4e37-bf15-76c5b45bf59b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:18.526056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-247eb416-0bde-4e37-bf15-76c5b45bf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:18.534609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:18.684355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7817-f550-451c-bd73-8d9480e09995 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:18.698636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7817-f550-451c-bd73-8d9480e09995 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:18.703837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5e89d-e0fa-4069-b4ee-d056c7ad594f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:18.704455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5e89d-e0fa-4069-b4ee-d056c7ad594f service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:18.704731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5e89d-e0fa-4069-b4ee-d056c7ad594f service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:18.705001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5e89d-e0fa-4069-b4ee-d056c7ad594f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:18.713274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5e89d-e0fa-4069-b4ee-d056c7ad594f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:18.714866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5e89d-e0fa-4069-b4ee-d056c7ad594f service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:18.723924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 704/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:19.921719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191cd11-2377-43f1-a765-b5c4a05381bf None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:19.922292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191cd11-2377-43f1-a765-b5c4a05381bf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:19.922292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191cd11-2377-43f1-a765-b5c4a05381bf None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:19.923654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:19.929156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693740f-dcf7-4b44-846b-ecca63989c60 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:19.929611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693740f-dcf7-4b44-846b-ecca63989c60 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:19.929742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693740f-dcf7-4b44-846b-ecca63989c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:19.947038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a693740f-dcf7-4b44-846b-ecca63989c60 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:19.948230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a693740f-dcf7-4b44-846b-ecca63989c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:19.955813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:20.103895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191cd11-2377-43f1-a765-b5c4a05381bf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:20.118485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191cd11-2377-43f1-a765-b5c4a05381bf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:20.123847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ec77a-3854-4c1a-aa23-59e699bfee52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:20.124474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec77a-3854-4c1a-aa23-59e699bfee52 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:20.124754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec77a-3854-4c1a-aa23-59e699bfee52 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:20.125025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec77a-3854-4c1a-aa23-59e699bfee52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:20.133185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec77a-3854-4c1a-aa23-59e699bfee52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:20.134786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec77a-3854-4c1a-aa23-59e699bfee52 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:20.143846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 732/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:21.328886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd76a-d85e-480a-b034-5131a629c86a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:21.329414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd76a-d85e-480a-b034-5131a629c86a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:21.329414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd76a-d85e-480a-b034-5131a629c86a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:21.330764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:21.335797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359f6a-9e16-4b20-99be-7642a05f5444 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:21.336210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359f6a-9e16-4b20-99be-7642a05f5444 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:21.336349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359f6a-9e16-4b20-99be-7642a05f5444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:21.354181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-98359f6a-9e16-4b20-99be-7642a05f5444 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:21.355360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-98359f6a-9e16-4b20-99be-7642a05f5444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:21.363790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:21.512172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd76a-d85e-480a-b034-5131a629c86a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:21.526214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd76a-d85e-480a-b034-5131a629c86a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:21.532039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91267e-7275-4136-b25a-cd10000bd457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:21.532667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91267e-7275-4136-b25a-cd10000bd457 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:21.532949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91267e-7275-4136-b25a-cd10000bd457 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:21.533225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91267e-7275-4136-b25a-cd10000bd457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:21.541879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91267e-7275-4136-b25a-cd10000bd457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:21.543461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91267e-7275-4136-b25a-cd10000bd457 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:21.553125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 707/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:23.685452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409cda-f24f-4d56-a300-323fbed5066d None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:23.686084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409cda-f24f-4d56-a300-323fbed5066d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:23.686084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409cda-f24f-4d56-a300-323fbed5066d None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:23.687390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:01:23.692600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95616-dfc1-4eff-8e84-91ed4600b6cc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:23.693005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95616-dfc1-4eff-8e84-91ed4600b6cc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:23.693165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95616-dfc1-4eff-8e84-91ed4600b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:23.710229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-68f95616-dfc1-4eff-8e84-91ed4600b6cc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:23.711419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-68f95616-dfc1-4eff-8e84-91ed4600b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:23.719184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:23.759333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409cda-f24f-4d56-a300-323fbed5066d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:23.769603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409cda-f24f-4d56-a300-323fbed5066d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:23.772990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02cf83-45e0-4ffa-83ee-5599d34db0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:23.773641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02cf83-45e0-4ffa-83ee-5599d34db0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:23.773921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02cf83-45e0-4ffa-83ee-5599d34db0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:23.774193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02cf83-45e0-4ffa-83ee-5599d34db0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:23.782612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02cf83-45e0-4ffa-83ee-5599d34db0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:23.784025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02cf83-45e0-4ffa-83ee-5599d34db0c4 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:23.794144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 735/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:26.166477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e370ae-2ef2-4a75-8b40-43294f82bfac None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:26.167022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e370ae-2ef2-4a75-8b40-43294f82bfac None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:26.167022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e370ae-2ef2-4a75-8b40-43294f82bfac None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:26.168408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:26.173793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147894-3ad5-456d-8d4d-9467f7760c42 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:26.174227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147894-3ad5-456d-8d4d-9467f7760c42 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:26.174349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147894-3ad5-456d-8d4d-9467f7760c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:26.191916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b0147894-3ad5-456d-8d4d-9467f7760c42 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:26.193126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b0147894-3ad5-456d-8d4d-9467f7760c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:26.200714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:26.239077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e370ae-2ef2-4a75-8b40-43294f82bfac None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:26.240733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-07e370ae-2ef2-4a75-8b40-43294f82bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:26.253893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e370ae-2ef2-4a75-8b40-43294f82bfac None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:26.257354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dbf03-5ed8-480f-995b-473209776141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:26.258018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dbf03-5ed8-480f-995b-473209776141 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:26.258307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dbf03-5ed8-480f-995b-473209776141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:26.258584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dbf03-5ed8-480f-995b-473209776141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:26.267180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dbf03-5ed8-480f-995b-473209776141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:26.268600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dbf03-5ed8-480f-995b-473209776141 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:26.277775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 710/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:28.881426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91317c4-4e47-4b75-be55-55ff7d29ccdd None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:28.882054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91317c4-4e47-4b75-be55-55ff7d29ccdd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:28.882054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91317c4-4e47-4b75-be55-55ff7d29ccdd None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:28.883389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:28.888631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9927567-193a-4faa-825a-43ee9bcf70fd None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:28.889066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9927567-193a-4faa-825a-43ee9bcf70fd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:28.889225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9927567-193a-4faa-825a-43ee9bcf70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:28.906347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f9927567-193a-4faa-825a-43ee9bcf70fd None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:28.908039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f9927567-193a-4faa-825a-43ee9bcf70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:28.916147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:28.953345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91317c4-4e47-4b75-be55-55ff7d29ccdd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:28.963615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91317c4-4e47-4b75-be55-55ff7d29ccdd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:28.967062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ee5ff-00fd-45f3-9691-c38d7a395b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:28.967678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ee5ff-00fd-45f3-9691-c38d7a395b72 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:28.967955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ee5ff-00fd-45f3-9691-c38d7a395b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:28.968224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ee5ff-00fd-45f3-9691-c38d7a395b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:28.977127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ee5ff-00fd-45f3-9691-c38d7a395b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:28.978561 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ee5ff-00fd-45f3-9691-c38d7a395b72 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:28.988124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 738/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:31.395534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b73f-f814-4669-9221-f0dff1c879f6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:31.396120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b73f-f814-4669-9221-f0dff1c879f6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:31.396120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b73f-f814-4669-9221-f0dff1c879f6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:31.397469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:31.405597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b2d1-31fd-4669-a3f5-208c8f30176a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:31.406136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b2d1-31fd-4669-a3f5-208c8f30176a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:31.406136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b2d1-31fd-4669-a3f5-208c8f30176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:31.424103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7a34b2d1-31fd-4669-a3f5-208c8f30176a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:31.425374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7a34b2d1-31fd-4669-a3f5-208c8f30176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:31.433736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:31.470225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41b73f-f814-4669-9221-f0dff1c879f6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:31.481217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41b73f-f814-4669-9221-f0dff1c879f6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:31.484759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608641c-2d42-46dc-9ae3-703d0a5dbef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:31.485392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608641c-2d42-46dc-9ae3-703d0a5dbef6 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:31.485717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608641c-2d42-46dc-9ae3-703d0a5dbef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:31.485997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608641c-2d42-46dc-9ae3-703d0a5dbef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:31.495284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608641c-2d42-46dc-9ae3-703d0a5dbef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:31.496717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608641c-2d42-46dc-9ae3-703d0a5dbef6 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:31.505883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 713/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:33.803740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fea19-1fc2-4a22-ad9c-8139df3c60fa None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:33.804281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fea19-1fc2-4a22-ad9c-8139df3c60fa None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:33.804281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fea19-1fc2-4a22-ad9c-8139df3c60fa None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:33.805702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:33.811981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060130a8-2578-4482-b13f-2fb1d4c43451 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:33.812386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060130a8-2578-4482-b13f-2fb1d4c43451 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:33.812544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060130a8-2578-4482-b13f-2fb1d4c43451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:33.830186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-060130a8-2578-4482-b13f-2fb1d4c43451 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:33.831372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-060130a8-2578-4482-b13f-2fb1d4c43451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:33.839063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:33.875766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fea19-1fc2-4a22-ad9c-8139df3c60fa None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:33.886694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fea19-1fc2-4a22-ad9c-8139df3c60fa None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:33.890091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c0036-97c2-42da-ade2-1b7b8b15bd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:33.890713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c0036-97c2-42da-ade2-1b7b8b15bd36 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:33.890992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c0036-97c2-42da-ade2-1b7b8b15bd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:33.891264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c0036-97c2-42da-ade2-1b7b8b15bd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:33.899760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c0036-97c2-42da-ade2-1b7b8b15bd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:33.901476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c0036-97c2-42da-ade2-1b7b8b15bd36 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:33.910769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 741/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:36.211015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb149-cb4f-4e78-9dd9-fab71dfd33ee None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:36.211558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb149-cb4f-4e78-9dd9-fab71dfd33ee None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:36.211558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb149-cb4f-4e78-9dd9-fab71dfd33ee None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:36.212951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:36.218376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd195e-5101-4536-9dfc-7f8d9f4320fb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:36.218780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd195e-5101-4536-9dfc-7f8d9f4320fb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:36.218943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd195e-5101-4536-9dfc-7f8d9f4320fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:36.236568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4acd195e-5101-4536-9dfc-7f8d9f4320fb None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:36.237822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4acd195e-5101-4536-9dfc-7f8d9f4320fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:36.245643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:36.282943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eb149-cb4f-4e78-9dd9-fab71dfd33ee None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:36.294221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eb149-cb4f-4e78-9dd9-fab71dfd33ee None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:36.297668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94efe-9100-4e12-9ea5-6bc6b1ed08bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:36.298292 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94efe-9100-4e12-9ea5-6bc6b1ed08bc service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:36.298571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94efe-9100-4e12-9ea5-6bc6b1ed08bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:36.298845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94efe-9100-4e12-9ea5-6bc6b1ed08bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:36.307358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94efe-9100-4e12-9ea5-6bc6b1ed08bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:36.308760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94efe-9100-4e12-9ea5-6bc6b1ed08bc service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:36.317681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 716/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:38.612154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1644d-9c7b-4f73-958f-474e9a4a9dea None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:38.613273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1644d-9c7b-4f73-958f-474e9a4a9dea None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:38.613273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1644d-9c7b-4f73-958f-474e9a4a9dea None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:38.614712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:38.620002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b994a84-14b6-46ad-ae59-edd2e79afa8c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:38.620404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b994a84-14b6-46ad-ae59-edd2e79afa8c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:38.620551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b994a84-14b6-46ad-ae59-edd2e79afa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:38.637771 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3b994a84-14b6-46ad-ae59-edd2e79afa8c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:38.638948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3b994a84-14b6-46ad-ae59-edd2e79afa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:38.646619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:38.684929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1644d-9c7b-4f73-958f-474e9a4a9dea None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:38.695294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1644d-9c7b-4f73-958f-474e9a4a9dea None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:38.698735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58673e81-fe10-4ccb-9001-8482d4b5da77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:38.699362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673e81-fe10-4ccb-9001-8482d4b5da77 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:38.699643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673e81-fe10-4ccb-9001-8482d4b5da77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:38.699918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673e81-fe10-4ccb-9001-8482d4b5da77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:38.708406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58673e81-fe10-4ccb-9001-8482d4b5da77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:38.709846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58673e81-fe10-4ccb-9001-8482d4b5da77 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:38.718906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 744/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:40.982493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb10c-b8b8-4b12-ae9e-58cfb141b6cf None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:40.982979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb10c-b8b8-4b12-ae9e-58cfb141b6cf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:40.983094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb10c-b8b8-4b12-ae9e-58cfb141b6cf None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:40.984453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:40.989542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39cf2-43e4-491b-be55-998601e017fe None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:40.990000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39cf2-43e4-491b-be55-998601e017fe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:40.990135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39cf2-43e4-491b-be55-998601e017fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:41.007495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-eff39cf2-43e4-491b-be55-998601e017fe None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:41.008662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eff39cf2-43e4-491b-be55-998601e017fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:41.016634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:01:41.054021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb10c-b8b8-4b12-ae9e-58cfb141b6cf None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:41.064401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb10c-b8b8-4b12-ae9e-58cfb141b6cf None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:41.068389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec97220-ea27-4f5a-a65e-42354155e804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:41.069013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97220-ea27-4f5a-a65e-42354155e804 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:41.069299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97220-ea27-4f5a-a65e-42354155e804 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:41.069606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97220-ea27-4f5a-a65e-42354155e804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:41.078158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec97220-ea27-4f5a-a65e-42354155e804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:41.079619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec97220-ea27-4f5a-a65e-42354155e804 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:41.089249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 719/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:43.332342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d279a4e-6461-4be4-94d1-909263dd3949 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:43.332854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d279a4e-6461-4be4-94d1-909263dd3949 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:43.332854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d279a4e-6461-4be4-94d1-909263dd3949 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:43.334234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:43.339515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fcd3-f4fc-400f-82b0-7fc812787e57 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:43.339954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fcd3-f4fc-400f-82b0-7fc812787e57 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:43.340053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fcd3-f4fc-400f-82b0-7fc812787e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:43.357530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9fd8fcd3-f4fc-400f-82b0-7fc812787e57 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:43.358759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9fd8fcd3-f4fc-400f-82b0-7fc812787e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:43.367022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:43.402172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d279a4e-6461-4be4-94d1-909263dd3949 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:43.413463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d279a4e-6461-4be4-94d1-909263dd3949 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:43.416938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e79cc9-e813-4ac8-9977-b358a3f7b6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:43.417581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79cc9-e813-4ac8-9977-b358a3f7b6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:43.417867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79cc9-e813-4ac8-9977-b358a3f7b6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:43.418145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79cc9-e813-4ac8-9977-b358a3f7b6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:43.427494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e79cc9-e813-4ac8-9977-b358a3f7b6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:43.428905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e79cc9-e813-4ac8-9977-b358a3f7b6c1 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:43.438001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 747/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:01:45.739871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914da6b-be2e-46d2-b2c4-be25b83ee3dd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:45.740448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914da6b-be2e-46d2-b2c4-be25b83ee3dd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:45.740562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914da6b-be2e-46d2-b2c4-be25b83ee3dd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:45.741962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:01:45.747717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2bfa1-c31f-4bee-b042-b7614bf92ab3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:45.748161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2bfa1-c31f-4bee-b042-b7614bf92ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:45.748458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2bfa1-c31f-4bee-b042-b7614bf92ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:45.766265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-45a2bfa1-c31f-4bee-b042-b7614bf92ab3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:01:45.767475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-45a2bfa1-c31f-4bee-b042-b7614bf92ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:01:45.777377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:01:45.814457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914da6b-be2e-46d2-b2c4-be25b83ee3dd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:01:45.825001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914da6b-be2e-46d2-b2c4-be25b83ee3dd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:01:45.828447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d1de4-28ee-49f0-b60d-21ddc6feed18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:01:45.829075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1de4-28ee-49f0-b60d-21ddc6feed18 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:01:45.829353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1de4-28ee-49f0-b60d-21ddc6feed18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:01:45.829652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1de4-28ee-49f0-b60d-21ddc6feed18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:01:45.839468 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d1de4-28ee-49f0-b60d-21ddc6feed18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:01:45.841037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d1de4-28ee-49f0-b60d-21ddc6feed18 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:01:45.850955 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 722/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:02:19.403191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803703-e2ad-4053-9e21-2f9ef0883453 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:19.403768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803703-e2ad-4053-9e21-2f9ef0883453 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:19.404030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803703-e2ad-4053-9e21-2f9ef0883453 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:19.405434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 749/1471] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:19.410818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055416-2fd7-443a-830d-1191e794e1e1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:19.411232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055416-2fd7-443a-830d-1191e794e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:19.411375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055416-2fd7-443a-830d-1191e794e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:19.428838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0c055416-2fd7-443a-830d-1191e794e1e1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:19.430036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0c055416-2fd7-443a-830d-1191e794e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:19.437719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 723/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:02:19.484033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b7ac7-75c4-4809-b5e4-da1f2b6dba73 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:19.484323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b7ac7-75c4-4809-b5e4-da1f2b6dba73 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:19.484604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b7ac7-75c4-4809-b5e4-da1f2b6dba73 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:19.485995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 750/1473] 10.222.0.20 () {54 vars in 962 bytes} [Thu Apr 28 14:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:19.495653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b57a-44f2-4a4d-8430-285d973a22f3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:19.495946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b57a-44f2-4a4d-8430-285d973a22f3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:19.496209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b57a-44f2-4a4d-8430-285d973a22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:19.516161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ac73b57a-44f2-4a4d-8430-285d973a22f3 None None] MFA Rules not processed for user `562f710be70f4e11a67dc65b1adb5c89`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:19.517349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ac73b57a-44f2-4a4d-8430-285d973a22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:19.526036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 724/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Apr 28 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:02:19.534328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b7ac7-75c4-4809-b5e4-da1f2b6dba73 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:19.553403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b7ac7-75c4-4809-b5e4-da1f2b6dba73 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:19.557203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c07a2-3c89-408b-a74b-faaab9877ea3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:19.557868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c07a2-3c89-408b-a74b-faaab9877ea3 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:19.558151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c07a2-3c89-408b-a74b-faaab9877ea3 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:19.558429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c07a2-3c89-408b-a74b-faaab9877ea3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:19.567602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c07a2-3c89-408b-a74b-faaab9877ea3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:19.569016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c07a2-3c89-408b-a74b-faaab9877ea3 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:19.578071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 751/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:02:21.883966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2b59-593b-4f70-93a7-645a70304c4d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:21.884517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2b59-593b-4f70-93a7-645a70304c4d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:21.884517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2b59-593b-4f70-93a7-645a70304c4d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:21.885978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 725/1476] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:21.891285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b59f3-b87e-484a-bdb6-0ba04a352b59 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:21.891700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b59f3-b87e-484a-bdb6-0ba04a352b59 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:21.891825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b59f3-b87e-484a-bdb6-0ba04a352b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:21.909672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ab0b59f3-b87e-484a-bdb6-0ba04a352b59 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:21.910873 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ab0b59f3-b87e-484a-bdb6-0ba04a352b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:21.918865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 752/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:02:21.942508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2b59-593b-4f70-93a7-645a70304c4d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:21.954827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2b59-593b-4f70-93a7-645a70304c4d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:21.959316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:21.959953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:21.960238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:21.960514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:21.961241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:21.963067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:02:21.963067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:02:21.963067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:02:21.964216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92f5bf-81ea-49fb-b8e1-6e64034c1b9e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:21.982954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 726/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Apr 28 14:02:21 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:02:24.248485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3266c11-6dfe-4d85-b45a-5b24adf00050 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:24.249013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3266c11-6dfe-4d85-b45a-5b24adf00050 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:24.249112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3266c11-6dfe-4d85-b45a-5b24adf00050 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:24.250494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 753/1479] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:24.255781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee80bdc-fb14-4d7d-b524-20e79ff15e1b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:24.256211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee80bdc-fb14-4d7d-b524-20e79ff15e1b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:24.256570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee80bdc-fb14-4d7d-b524-20e79ff15e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:24.275523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4ee80bdc-fb14-4d7d-b524-20e79ff15e1b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:24.276761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4ee80bdc-fb14-4d7d-b524-20e79ff15e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:24.285167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 727/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:02:24.325890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3266c11-6dfe-4d85-b45a-5b24adf00050 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:24.340100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3266c11-6dfe-4d85-b45a-5b24adf00050 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:24.345376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252fd03-d14e-4956-9af5-41e6775f2818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:24.346100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252fd03-d14e-4956-9af5-41e6775f2818 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:24.346878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252fd03-d14e-4956-9af5-41e6775f2818 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:24.347148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252fd03-d14e-4956-9af5-41e6775f2818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:24.355058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252fd03-d14e-4956-9af5-41e6775f2818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:24.356553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252fd03-d14e-4956-9af5-41e6775f2818 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:24.365635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 754/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:02:26.779346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f73a2-7897-4444-91e5-048ffbb2a453 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:26.779915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f73a2-7897-4444-91e5-048ffbb2a453 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:26.779915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f73a2-7897-4444-91e5-048ffbb2a453 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:26.781245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 728/1482] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:26.786488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7c98c-1adf-44aa-98c3-e3f79f93d006 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:26.786950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7c98c-1adf-44aa-98c3-e3f79f93d006 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:26.787057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7c98c-1adf-44aa-98c3-e3f79f93d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:26.804565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-aff7c98c-1adf-44aa-98c3-e3f79f93d006 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:26.805783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aff7c98c-1adf-44aa-98c3-e3f79f93d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:26.813455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 755/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:02:26.849378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f73a2-7897-4444-91e5-048ffbb2a453 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:26.859750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f73a2-7897-4444-91e5-048ffbb2a453 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:26.863201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73239-16f8-491c-ac33-1884972de732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:26.863823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73239-16f8-491c-ac33-1884972de732 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:26.864101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73239-16f8-491c-ac33-1884972de732 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:26.864373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73239-16f8-491c-ac33-1884972de732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:26.872834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73239-16f8-491c-ac33-1884972de732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:26.874287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73239-16f8-491c-ac33-1884972de732 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:26.883816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 729/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:02:29.169723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609edf91-468a-47e5-bec4-39738fe1ad94 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:29.170342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609edf91-468a-47e5-bec4-39738fe1ad94 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:29.170342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609edf91-468a-47e5-bec4-39738fe1ad94 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:29.171634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 756/1485] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:29.177250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88dadd-a3e8-4a95-9a1d-9ccdc04691aa None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:29.177708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88dadd-a3e8-4a95-9a1d-9ccdc04691aa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:29.177851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88dadd-a3e8-4a95-9a1d-9ccdc04691aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:29.195073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4e88dadd-a3e8-4a95-9a1d-9ccdc04691aa None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:29.196187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4e88dadd-a3e8-4a95-9a1d-9ccdc04691aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:29.204042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 730/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:02:29.242156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609edf91-468a-47e5-bec4-39738fe1ad94 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:29.252747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609edf91-468a-47e5-bec4-39738fe1ad94 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:29.256263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e81c-9e54-40de-98d1-815a2f41c94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:29.256895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e81c-9e54-40de-98d1-815a2f41c94c service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:29.257175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e81c-9e54-40de-98d1-815a2f41c94c service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:29.257448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e81c-9e54-40de-98d1-815a2f41c94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:29.266101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61e81c-9e54-40de-98d1-815a2f41c94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:29.267523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61e81c-9e54-40de-98d1-815a2f41c94c service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:29.277160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 757/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:02:31.623902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd0dbf-065d-479e-9fc7-c79eeeea9247 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:31.624461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd0dbf-065d-479e-9fc7-c79eeeea9247 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:31.624461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd0dbf-065d-479e-9fc7-c79eeeea9247 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:31.625875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 731/1488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:31.631025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712babf8-bbdc-41f5-b93e-e9887777a917 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:31.631409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712babf8-bbdc-41f5-b93e-e9887777a917 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:31.631571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712babf8-bbdc-41f5-b93e-e9887777a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:31.648930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-712babf8-bbdc-41f5-b93e-e9887777a917 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:31.650131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-712babf8-bbdc-41f5-b93e-e9887777a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:31.659714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 758/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:02:31.698763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd0dbf-065d-479e-9fc7-c79eeeea9247 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:31.709692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd0dbf-065d-479e-9fc7-c79eeeea9247 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:31.713157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de339d-862d-4bc8-8bb6-22abb4e05138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:31.713824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de339d-862d-4bc8-8bb6-22abb4e05138 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:31.714106 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de339d-862d-4bc8-8bb6-22abb4e05138 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:31.714381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de339d-862d-4bc8-8bb6-22abb4e05138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:31.723481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de339d-862d-4bc8-8bb6-22abb4e05138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:31.724906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de339d-862d-4bc8-8bb6-22abb4e05138 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:31.733966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 732/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:02:34.230328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58679a-d127-4f75-a9f4-c51078f67e7c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:34.230874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58679a-d127-4f75-a9f4-c51078f67e7c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:34.230874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58679a-d127-4f75-a9f4-c51078f67e7c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:34.232262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 759/1491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Apr 28 14:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:02:34.238034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f756-ac7c-4d80-90c3-ae70809a0c0d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:34.238482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f756-ac7c-4d80-90c3-ae70809a0c0d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:34.238602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f756-ac7c-4d80-90c3-ae70809a0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:34.255520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2416f756-ac7c-4d80-90c3-ae70809a0c0d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:02:34.256698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2416f756-ac7c-4d80-90c3-ae70809a0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:02:34.264623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 733/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Apr 28 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:02:34.304504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58679a-d127-4f75-a9f4-c51078f67e7c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:02:34.314905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58679a-d127-4f75-a9f4-c51078f67e7c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:02:34.318402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098b68-1502-43eb-a8b2-0bc14f3a77bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:02:34.319026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098b68-1502-43eb-a8b2-0bc14f3a77bb service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:02:34.319307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098b68-1502-43eb-a8b2-0bc14f3a77bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:02:34.319585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098b68-1502-43eb-a8b2-0bc14f3a77bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:02:34.328210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098b68-1502-43eb-a8b2-0bc14f3a77bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:02:34.329688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098b68-1502-43eb-a8b2-0bc14f3a77bb service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:02:34.338784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 760/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:04:08.573031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.573660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.573660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.591513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:04:08.592692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:04:08.600945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 734/1494] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:04:08.608799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.609282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.609386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.626843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:04:08.628015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:04:08.635912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 761/1495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:04:08.640242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:08.650119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565156b2-fa06-4eda-93d9-564c689db21f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:08.654607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:08.655246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.655530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.655802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.656514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:04:08.657388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:08.658456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:08.658456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:04:08.658456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:04:08.659345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:08.670883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 735/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:04:08.678805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:08.687674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa8b47-1b17-4d49-ba11-54c21f1e6eff None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:08.692163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:08.692803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.693088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.693362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.694079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:08.695813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:08.695813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:04:08.695813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:04:08.696990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:08.739051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 762/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:04:08 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:04:08.743266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:08.753618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6e972-e725-49b1-aaf9-2fd93a94a94d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:08.807084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:08.807744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.808030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.808310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.809000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:08.810039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:08.810039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:04:08.810039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:04:08.811239 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:08.830648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 736/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:04:08 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:04:08.834590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:08.845052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77bfe5-6806-4c81-9e75-1ed805e301ba admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:08.849544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:08.850221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.850499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.850772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.851487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:08.852480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:08.852480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:04:08.852480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:04:08.853346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:08.865532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 763/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:04:08.869313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:08.878949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a30a76-fd96-475a-850c-4206e673363c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:08.883553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:08.884201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.884487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.884766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.885517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:08.886545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:08.886545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:04:08.886545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:04:08.887424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b848e3-64b2-4e10-b388-b0e4800792fe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:08.900908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 737/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:04:08.904843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:08.914600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f1e83-cec8-4af0-b967-6a66eb60e2c7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:08.918995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:08.919844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.920121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.920392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] PATH_INFO: `/v3/projects/6a7f08978eaf439cbd33c0e25b5a1cd2/users/62d057560ea04d08babfce66502014ba/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.934581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7f08978eaf439cbd33c0e25b5a1cd2, user_id=62d057560ea04d08babfce66502014ba, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:08.935594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:08.935594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:04:08.935594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:04:08.937497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:08.949935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 764/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:04:08 2022] PUT /identity/v3/projects/6a7f08978eaf439cbd33c0e25b5a1cd2/users/62d057560ea04d08babfce66502014ba/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:04:08.960983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44229-3e8b-40d1-b2c1-56fe65159c44 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:08.961279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44229-3e8b-40d1-b2c1-56fe65159c44 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:08.961582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44229-3e8b-40d1-b2c1-56fe65159c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:08.987837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-09f44229-3e8b-40d1-b2c1-56fe65159c44 None None] MFA Rules not processed for user `62d057560ea04d08babfce66502014ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:04:08.989037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-09f44229-3e8b-40d1-b2c1-56fe65159c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:04:09.055759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 738/1502] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:04:09.066702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:09.132895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f55ab-14a0-4fe4-8355-dba4a11ffd68 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:09.138441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:09.139082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:09.139365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:09.139641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:09.147797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:09.149413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:09.157955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 765/1503] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:04:09.227382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f8af-54f7-48ba-a4c8-dc481efc218a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:09.227679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f8af-54f7-48ba-a4c8-dc481efc218a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:09.227963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f8af-54f7-48ba-a4c8-dc481efc218a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:09.229277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 739/1504] 10.222.0.20 () {52 vars in 829 bytes} [Thu Apr 28 14:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:04:09.232817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:09.292100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704be59-0fc9-4d14-b1f4-f00a7f938f08 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:09.296544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:09.297422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:09.297735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:09.298003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] PATH_INFO: `/v3/users/62d057560ea04d08babfce66502014ba` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:09.299161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d057560ea04d08babfce66502014ba)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:09.300162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:09.300162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:04:09.300162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:04:09.301357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:09.363003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d057560ea04d08babfce66502014ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:09.380697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d057560ea04d08babfce66502014ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:09.389680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d057560ea04d08babfce66502014ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:09.390393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d057560ea04d08babfce66502014ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:09.402493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d057560ea04d08babfce66502014ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:09.408254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 766/1505] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:04:09 2022] DELETE /identity/v3/users/62d057560ea04d08babfce66502014ba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:04:09.412580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:09.412879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:09.413164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:09.430869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:04:09.432074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:04:09.487390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 740/1506] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:04:09.497418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:09.499285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:04:09.555715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23294d83-7791-4a16-8daf-f977b7d5e62f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:09.559293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0159f1-6b35-4529-9774-483e4758a3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:09.559933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0159f1-6b35-4529-9774-483e4758a3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:09.560217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0159f1-6b35-4529-9774-483e4758a3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:09.560490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0159f1-6b35-4529-9774-483e4758a3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:09.569805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0159f1-6b35-4529-9774-483e4758a3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:09.571236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0159f1-6b35-4529-9774-483e4758a3e4 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:09.580498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 767/1507] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:04:09.921122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:04:09.923196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:04:09.935082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd514f-a501-482b-a4c8-fb5171b1662b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:04:09.939723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:04:09.940581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:04:09.940870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:04:09.941149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] PATH_INFO: `/v3/projects/6a7f08978eaf439cbd33c0e25b5a1cd2` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:04:09.942356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7f08978eaf439cbd33c0e25b5a1cd2)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:04:09.943376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:04:09.943376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:04:09.943376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:04:09.944679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:04:10.008325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7f08978eaf439cbd33c0e25b5a1cd2', 'request_id': 'req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:10.018733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7f08978eaf439cbd33c0e25b5a1cd2', 'request_id': 'req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:10.033856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7f08978eaf439cbd33c0e25b5a1cd2', 'request_id': 'req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:10.044665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] The token cache is being invalidate because project 6a7f08978eaf439cbd33c0e25b5a1cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:04:10.044946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:10.045602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bdcc69a0-3a5d-4437-841a-d5c62c73d7d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:04:10.047296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 741/1508] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:04:09 2022] DELETE /identity/v3/projects/6a7f08978eaf439cbd33c0e25b5a1cd2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:05:50.594331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b505-6289-42b7-ae18-7fa9b2aefa4f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:05:50.594914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b505-6289-42b7-ae18-7fa9b2aefa4f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:05:50.594914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b505-6289-42b7-ae18-7fa9b2aefa4f None None] PATH_INFO: `/v3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:05:50.596292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 768/1509] 10.222.0.13 () {54 vars in 925 bytes} [Thu Apr 28 14:05:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:05:50.610107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bad3c-cba1-45db-bb5a-f674d6a36683 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:05:50.610579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bad3c-cba1-45db-bb5a-f674d6a36683 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:05:50.610683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bad3c-cba1-45db-bb5a-f674d6a36683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:05:50.629416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f29bad3c-cba1-45db-bb5a-f674d6a36683 None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:05:50.630765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f29bad3c-cba1-45db-bb5a-f674d6a36683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:05:50.696377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 742/1510] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Apr 28 14:05:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:05:54.554094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70a46-00db-4a89-9527-d476a06f5ce7 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:05:54.554656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70a46-00db-4a89-9527-d476a06f5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:05:54.554656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70a46-00db-4a89-9527-d476a06f5ce7 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:05:54.556046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 769/1511] 10.222.0.20 () {54 vars in 960 bytes} [Thu Apr 28 14:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:05:54.561008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5701-854b-4fcc-a650-2374bfe00001 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:05:54.561455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5701-854b-4fcc-a650-2374bfe00001 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:05:54.561579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5701-854b-4fcc-a650-2374bfe00001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:05:54.579592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9b0a5701-854b-4fcc-a650-2374bfe00001 None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:05:54.581156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9b0a5701-854b-4fcc-a650-2374bfe00001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:05:54.592177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 743/1512] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Apr 28 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:05:54.599649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70a46-00db-4a89-9527-d476a06f5ce7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:05:54.613776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70a46-00db-4a89-9527-d476a06f5ce7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:05:54.618705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b5bc7-fd0e-4e5e-8d4c-ba841f92edeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:05:54.619338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b5bc7-fd0e-4e5e-8d4c-ba841f92edeb service placement] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:05:54.619619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b5bc7-fd0e-4e5e-8d4c-ba841f92edeb service placement] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:05:54.619903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b5bc7-fd0e-4e5e-8d4c-ba841f92edeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:05:54.628152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b5bc7-fd0e-4e5e-8d4c-ba841f92edeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:05:54.629776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b5bc7-fd0e-4e5e-8d4c-ba841f92edeb service placement] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:05:54.639338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 770/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:05:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:07:24.460601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5f21-ced2-4fe3-82e5-39a0f50476f3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:24.461792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5f21-ced2-4fe3-82e5-39a0f50476f3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:24.461792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5f21-ced2-4fe3-82e5-39a0f50476f3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:24.463119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:07:24.467871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a808a-6980-4c09-9aef-47f9921ed9d8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:24.468278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a808a-6980-4c09-9aef-47f9921ed9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:24.468435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a808a-6980-4c09-9aef-47f9921ed9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:24.486321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-124a808a-6980-4c09-9aef-47f9921ed9d8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:24.487519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-124a808a-6980-4c09-9aef-47f9921ed9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:24.550491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:24.703240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e5f21-ced2-4fe3-82e5-39a0f50476f3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:07:24.704899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3c1e5f21-ced2-4fe3-82e5-39a0f50476f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:24.778346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e5f21-ced2-4fe3-82e5-39a0f50476f3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:07:24.785227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fc826-dd34-424a-b60a-738de73e52cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:07:24.785905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc826-dd34-424a-b60a-738de73e52cc service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:24.786191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc826-dd34-424a-b60a-738de73e52cc service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:24.786729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc826-dd34-424a-b60a-738de73e52cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:24.795952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fc826-dd34-424a-b60a-738de73e52cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:07:24.797544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fc826-dd34-424a-b60a-738de73e52cc service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:07:24.807634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 745/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:07:26.036673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d04b-c2ab-4cdb-b6fd-0736286f1554 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:26.037252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d04b-c2ab-4cdb-b6fd-0736286f1554 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:26.037252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d04b-c2ab-4cdb-b6fd-0736286f1554 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:26.038656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 772/1517] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 14:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:07:26.043984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38d98-fa2c-4ffb-8d00-94bf7aff9fd5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:26.044447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38d98-fa2c-4ffb-8d00-94bf7aff9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:26.044552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38d98-fa2c-4ffb-8d00-94bf7aff9fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:26.062774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cfe38d98-fa2c-4ffb-8d00-94bf7aff9fd5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:26.063982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cfe38d98-fa2c-4ffb-8d00-94bf7aff9fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:26.072216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 746/1518] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:26.221508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d04b-c2ab-4cdb-b6fd-0736286f1554 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:07:26.235442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d04b-c2ab-4cdb-b6fd-0736286f1554 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:07:26.240709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8f9d-2e1d-4486-92eb-2903bc0ae04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:07:26.241329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8f9d-2e1d-4486-92eb-2903bc0ae04b service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:26.241641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8f9d-2e1d-4486-92eb-2903bc0ae04b service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:26.241917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8f9d-2e1d-4486-92eb-2903bc0ae04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:26.250239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c8f9d-2e1d-4486-92eb-2903bc0ae04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:07:26.251795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c8f9d-2e1d-4486-92eb-2903bc0ae04b service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:07:26.261845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 773/1519] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:07:30.535340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f44f-8fd7-4f49-85d8-75d749316069 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:30.535923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f44f-8fd7-4f49-85d8-75d749316069 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:30.535923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f44f-8fd7-4f49-85d8-75d749316069 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:30.537515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 747/1520] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:07:30.543312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c889e-3675-4041-a7e4-4eba42f70dca None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:30.543779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c889e-3675-4041-a7e4-4eba42f70dca None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:30.543888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c889e-3675-4041-a7e4-4eba42f70dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:30.562398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-491c889e-3675-4041-a7e4-4eba42f70dca None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:30.563587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-491c889e-3675-4041-a7e4-4eba42f70dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:30.571769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 774/1521] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:30.607429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f44f-8fd7-4f49-85d8-75d749316069 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:07:30.609108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-edf2f44f-8fd7-4f49-85d8-75d749316069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:30.663926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f44f-8fd7-4f49-85d8-75d749316069 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:07:30.667437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e604d05-a071-4216-b03b-d40ee7a5b6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:07:30.668068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604d05-a071-4216-b03b-d40ee7a5b6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:30.668352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604d05-a071-4216-b03b-d40ee7a5b6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:30.668629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604d05-a071-4216-b03b-d40ee7a5b6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:30.677402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e604d05-a071-4216-b03b-d40ee7a5b6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:07:30.678867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e604d05-a071-4216-b03b-d40ee7a5b6b7 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:07:30.688129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 748/1522] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:07:32.894892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475a8fc-8b0d-4fd4-be24-00d30363a253 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:32.895469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475a8fc-8b0d-4fd4-be24-00d30363a253 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:32.895469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475a8fc-8b0d-4fd4-be24-00d30363a253 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:32.896802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 775/1523] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:07:32.902273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a69a42-b664-4fc5-9069-3e726b7083af None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:32.902711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a69a42-b664-4fc5-9069-3e726b7083af None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:32.902819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a69a42-b664-4fc5-9069-3e726b7083af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:32.921210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-35a69a42-b664-4fc5-9069-3e726b7083af None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:32.922418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-35a69a42-b664-4fc5-9069-3e726b7083af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:32.930614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 749/1524] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:32.965293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475a8fc-8b0d-4fd4-be24-00d30363a253 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:07:32.966952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0475a8fc-8b0d-4fd4-be24-00d30363a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:32.980183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475a8fc-8b0d-4fd4-be24-00d30363a253 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:07:32.983579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68476b-ade3-44b8-b292-df09352e8654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:07:32.984203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68476b-ade3-44b8-b292-df09352e8654 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:32.984479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68476b-ade3-44b8-b292-df09352e8654 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:32.984750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68476b-ade3-44b8-b292-df09352e8654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:32.993835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68476b-ade3-44b8-b292-df09352e8654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:07:32.995246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68476b-ade3-44b8-b292-df09352e8654 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:07:33.004195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 776/1525] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:07:36.957656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a5353-48f8-4aec-87c1-f8abe7990c67 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:36.958278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a5353-48f8-4aec-87c1-f8abe7990c67 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:36.958278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a5353-48f8-4aec-87c1-f8abe7990c67 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:36.959629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 750/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:07:36.965504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648240f-2ceb-4057-9011-d94fcf92cb00 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:36.966038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648240f-2ceb-4057-9011-d94fcf92cb00 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:36.966130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648240f-2ceb-4057-9011-d94fcf92cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:36.984127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c648240f-2ceb-4057-9011-d94fcf92cb00 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:36.985320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c648240f-2ceb-4057-9011-d94fcf92cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:36.993156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 777/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:37.266519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a5353-48f8-4aec-87c1-f8abe7990c67 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:07:37.268190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-865a5353-48f8-4aec-87c1-f8abe7990c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:37.327405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a5353-48f8-4aec-87c1-f8abe7990c67 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:07:37.330893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1355-131a-460a-89d1-554fd38ce063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:07:37.331534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1355-131a-460a-89d1-554fd38ce063 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:37.331815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1355-131a-460a-89d1-554fd38ce063 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:37.332090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1355-131a-460a-89d1-554fd38ce063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:37.341361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1355-131a-460a-89d1-554fd38ce063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:07:37.342807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1355-131a-460a-89d1-554fd38ce063 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:07:37.351851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 751/1528] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:07:39.678315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef2c8-3af8-4be5-820f-db655b9b708a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:39.678922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef2c8-3af8-4be5-820f-db655b9b708a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:39.678922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef2c8-3af8-4be5-820f-db655b9b708a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:39.680862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 778/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 14:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:07:39.686128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181628-c1ba-4663-a341-51bc1205c567 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:39.686580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181628-c1ba-4663-a341-51bc1205c567 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:39.686690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181628-c1ba-4663-a341-51bc1205c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:39.704000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-72181628-c1ba-4663-a341-51bc1205c567 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:39.705181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-72181628-c1ba-4663-a341-51bc1205c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:39.712778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 752/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 14:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:39.983944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a4da-f710-44af-9b96-c96437e3ed33 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:39.984236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a4da-f710-44af-9b96-c96437e3ed33 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:39.984518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a4da-f710-44af-9b96-c96437e3ed33 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:39.986084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 779/1531] 10.222.0.20 () {54 vars in 962 bytes} [Thu Apr 28 14:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:07:39.990633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c577-e7e0-4a2e-8a3c-b58ae52f98f0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:39.990925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c577-e7e0-4a2e-8a3c-b58ae52f98f0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:39.991205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c577-e7e0-4a2e-8a3c-b58ae52f98f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:40.008825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b873c577-e7e0-4a2e-8a3c-b58ae52f98f0 None None] MFA Rules not processed for user `9e91a0ab4e4c4f4d96f357e7770a011a`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:07:40.010040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b873c577-e7e0-4a2e-8a3c-b58ae52f98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:07:40.016355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 753/1532] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Apr 28 14:07:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:07:40.024131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a4da-f710-44af-9b96-c96437e3ed33 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:07:40.034397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a4da-f710-44af-9b96-c96437e3ed33 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:07:40.038120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d3edf-dec8-46ce-94b7-8aea5f76e7fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:07:40.039337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3edf-dec8-46ce-94b7-8aea5f76e7fa service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:07:40.039619 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3edf-dec8-46ce-94b7-8aea5f76e7fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:07:40.039893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3edf-dec8-46ce-94b7-8aea5f76e7fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:07:40.048601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d3edf-dec8-46ce-94b7-8aea5f76e7fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:07:40.050066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d3edf-dec8-46ce-94b7-8aea5f76e7fa service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:07:40.059162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 780/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:12.307837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba907-75b1-447e-8469-203ecf5b42fe None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.308473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba907-75b1-447e-8469-203ecf5b42fe None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.308473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba907-75b1-447e-8469-203ecf5b42fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.326851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005f968-280b-43c7-b82b-3756d10d08d2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.326851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005f968-280b-43c7-b82b-3756d10d08d2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.327539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005f968-280b-43c7-b82b-3756d10d08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.336170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-450ba907-75b1-447e-8469-203ecf5b42fe None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.337447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-450ba907-75b1-447e-8469-203ecf5b42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.353523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 754/1534] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.354893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1005f968-280b-43c7-b82b-3756d10d08d2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.356854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1005f968-280b-43c7-b82b-3756d10d08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.366585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.367184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.367631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.380158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 781/1535] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:12.393518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.394487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.395026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.402410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.403944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.427010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 755/1536] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 28 14:09:12.430946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.432219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.432789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.453486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab1bed-49c7-417b-a32a-7bbec3186477 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.455548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 782/1537] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:12.460100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.466256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887514a0-28de-4248-8530-b57702490627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.467326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887514a0-28de-4248-8530-b57702490627 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.467844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887514a0-28de-4248-8530-b57702490627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.468368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887514a0-28de-4248-8530-b57702490627 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.469337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887514a0-28de-4248-8530-b57702490627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:12.469860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e35b9d-ff2a-4231-8393-b69732f364da None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.470130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887514a0-28de-4248-8530-b57702490627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.472793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887514a0-28de-4248-8530-b57702490627 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.488698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.489383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.489694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.489974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.490714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:12.491031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.492053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:09:12.492053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:09:12.492053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:09:12.493726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.496020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 756/1538] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:12.504791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887514a0-28de-4248-8530-b57702490627 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.518299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 783/1539] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:09:12.525588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887514a0-28de-4248-8530-b57702490627 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.527667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.538080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.538969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42563b-b5cb-4aaa-afac-2f3745c8ed48 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.539392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.539907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.540413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.541335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.542745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:09:12.542745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:09:12.542745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:09:12.544398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f535557-b589-48c6-b184-371c4708fe8e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.553797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.554469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.554890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.555174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.555872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.557819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.594943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 757/1540] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:12.596928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.597441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.601659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 784/1541] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:12.602203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.602499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.631297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.632514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.698067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 758/1542] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.698484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246205-9dc3-43c9-bfca-a3c51b552d41 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.699030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.706281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.707263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.707751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.708219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.708661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208374-0bde-4455-a52d-8f89a38ce076 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.709429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.710968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:09:12.710968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:09:12.710968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:09:12.713085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc04c6-8a46-4160-9139-f88c55db2e61 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.713638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82704c-ecdc-4cb8-90fd-69729eb13d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.714632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82704c-ecdc-4cb8-90fd-69729eb13d76 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.714925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82704c-ecdc-4cb8-90fd-69729eb13d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.715208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82704c-ecdc-4cb8-90fd-69729eb13d76 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.715904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82704c-ecdc-4cb8-90fd-69729eb13d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.717888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82704c-ecdc-4cb8-90fd-69729eb13d76 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.737014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 785/1543] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:12.738504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2148c4d-3bc5-4441-af10-7f282060ac9f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.738802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2148c4d-3bc5-4441-af10-7f282060ac9f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.739083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2148c4d-3bc5-4441-af10-7f282060ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.739347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 759/1544] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:12.740612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ef5c-184b-40cc-9d6f-38f9990b6bc9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.741027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ef5c-184b-40cc-9d6f-38f9990b6bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.741310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ef5c-184b-40cc-9d6f-38f9990b6bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.759741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c2148c4d-3bc5-4441-af10-7f282060ac9f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.759956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a057ef5c-184b-40cc-9d6f-38f9990b6bc9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.760953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a057ef5c-184b-40cc-9d6f-38f9990b6bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.761224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c2148c4d-3bc5-4441-af10-7f282060ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.768754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 760/1545] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.777463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 786/1546] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.777686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a513-1400-48f5-b0a8-4b0f1ba8fdca None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.777686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a513-1400-48f5-b0a8-4b0f1ba8fdca None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.777686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a513-1400-48f5-b0a8-4b0f1ba8fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.777939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c778c1c-e0e3-473c-8d4f-9d7cb8885eda None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.777939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c778c1c-e0e3-473c-8d4f-9d7cb8885eda None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.777939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c778c1c-e0e3-473c-8d4f-9d7cb8885eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.790326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8074a513-1400-48f5-b0a8-4b0f1ba8fdca None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.791522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8074a513-1400-48f5-b0a8-4b0f1ba8fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.793180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0c778c1c-e0e3-473c-8d4f-9d7cb8885eda None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.794371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0c778c1c-e0e3-473c-8d4f-9d7cb8885eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.799970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 761/1547] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.801189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.801497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.801782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.809119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 787/1548] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.809119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.809119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.809119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.826040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.827371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.827822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.828995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.835184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 762/1549] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.835951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.836966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 788/1550] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.842468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.845233 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7285f-2b08-46eb-8325-f8126f1e916e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.849907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1c989-7f4f-4a82-a606-c1d2fb502a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.850567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c989-7f4f-4a82-a606-c1d2fb502a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.850852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c989-7f4f-4a82-a606-c1d2fb502a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.851127 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c989-7f4f-4a82-a606-c1d2fb502a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.851848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1c989-7f4f-4a82-a606-c1d2fb502a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.852270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f074bb-a106-4dd3-9426-185b9b44fb43 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.853442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1c989-7f4f-4a82-a606-c1d2fb502a88 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.857628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b54c0-6146-4db0-a9b6-5bcf581cbae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.858291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b54c0-6146-4db0-a9b6-5bcf581cbae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.858569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b54c0-6146-4db0-a9b6-5bcf581cbae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.859242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b54c0-6146-4db0-a9b6-5bcf581cbae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.859564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b54c0-6146-4db0-a9b6-5bcf581cbae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.861131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b54c0-6146-4db0-a9b6-5bcf581cbae5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.863837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 763/1551] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:12.864884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4ff8-e715-4a1d-b849-5e29924378f9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.865176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4ff8-e715-4a1d-b849-5e29924378f9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.865454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4ff8-e715-4a1d-b849-5e29924378f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.870861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 789/1552] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:12.872918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb12850-ba59-43ce-a241-609c5b0e617c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.873807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb12850-ba59-43ce-a241-609c5b0e617c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.874184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb12850-ba59-43ce-a241-609c5b0e617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.883023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b27c4ff8-e715-4a1d-b849-5e29924378f9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.884213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b27c4ff8-e715-4a1d-b849-5e29924378f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.891316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9fb12850-ba59-43ce-a241-609c5b0e617c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.892299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 764/1553] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.892516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9fb12850-ba59-43ce-a241-609c5b0e617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.893626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.893916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.894194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.901807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 790/1554] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.902945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecc8df-aad4-4be2-92b6-f2c84e0e49c3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.903237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecc8df-aad4-4be2-92b6-f2c84e0e49c3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.903515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecc8df-aad4-4be2-92b6-f2c84e0e49c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.912774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.913975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.922002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f7ecc8df-aad4-4be2-92b6-f2c84e0e49c3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.922302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 765/1555] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.923062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.923168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7ecc8df-aad4-4be2-92b6-f2c84e0e49c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.931099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 791/1556] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.931936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea92c3-ff6c-4830-bd92-fc8961c47d0e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.932320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.932606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.932884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.938890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.939542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.939840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.940105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.940830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:12.941137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.942767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.949796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:12.950971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:12.964800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 766/1557] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:12.964800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.965103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 792/1558] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:12.965103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.965258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be271135-e0a1-4a37-8ab4-a40f337ee464 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.968682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf75e1-5252-4ef1-9e65-963ea7a1e123 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:12.973584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.974287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.974579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.974853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.975612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.977065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:12.977258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.977769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:12.978046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:12.978322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:12.979051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:12.980670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:12.990111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 767/1559] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:12.990941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:12.993379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 793/1560] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:12.993379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.001945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9e16c-1339-4e91-8a10-58b26accfc83 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.002395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7446da6-3855-40e5-80c2-f7bf3d8fbb45 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.006367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.007008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.007345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.007628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.008056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.008335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:13.008668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.009074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.009815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.010087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.010288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.010800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:13.011105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.013465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.026783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 794/1561] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:13.032368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 768/1562] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:13.032508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.032615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.039094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a3ad-7bbd-4645-840a-e174059646f0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.043654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.044492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.046091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.046225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.046912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:13.047224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.048823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.049245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6f15-e205-4bbb-ab80-226e1fd78088 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.053799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.054452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.054738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.055017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.055740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:13.056194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.057806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.060723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 769/1563] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:13.061438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.075872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 795/1564] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:13.075872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.076157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34064-3bb5-4385-84dd-ad4c805fb58b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.079756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.080602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.081381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.081381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.081916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:13.082229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.083852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.084634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8b9d0-c0b8-4be2-a705-73c10fd2b568 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.089127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.089787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.090069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.090341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.091021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.093457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.095984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 770/1565] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:13.098441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.111349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0e5c3-d733-4ae1-8416-1c3b9cf42ba5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.116523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.117515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.117842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.118185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] PATH_INFO: `/v3/projects/41351d6d88eb41e2a1cda97d9f0c77a1/users/fcace2ff87004618aa24c6cd2f457d01/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.123726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 796/1566] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.123726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.132539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41351d6d88eb41e2a1cda97d9f0c77a1, user_id=fcace2ff87004618aa24c6cd2f457d01, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.133640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:09:13.133640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:09:13.133640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:09:13.135502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.148127 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 771/1567] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:13 2022] PUT /identity/v3/projects/41351d6d88eb41e2a1cda97d9f0c77a1/users/fcace2ff87004618aa24c6cd2f457d01/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:13.148895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.182255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba11d5-40dc-4c9c-b453-d6cac6be5a56 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.208767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09617d-3701-40d2-9b3d-27035105ed2e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.213602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.214474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.214786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.215064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.215756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.218284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.236576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.237661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.238014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.238297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] PATH_INFO: `/v3/projects/657e313ac1b74d0abb25c21e17c7b96b/users/3bd6ea89c3584e50b6ff497428a11b6d/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.244172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 772/1568] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.244980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.252920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657e313ac1b74d0abb25c21e17c7b96b, user_id=3bd6ea89c3584e50b6ff497428a11b6d, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.255618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.268130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 797/1569] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:13 2022] PUT /identity/v3/projects/657e313ac1b74d0abb25c21e17c7b96b/users/3bd6ea89c3584e50b6ff497428a11b6d/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:13.269045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.314795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cb388-3051-481a-a272-1a384ebf4c95 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.337715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73186a93-0db2-4c82-9dca-546eac382903 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.342949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.343608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.343892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.344168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.344940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.346903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.371897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 798/1570] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.372717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.376841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.377514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.377828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.378114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.378807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.380801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.406395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 773/1571] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.406705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.432703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82884fa3-eca8-4656-aec1-d89a6e70daae admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.464086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e32ed3-ba90-43ec-96c6-8d881199617e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.469217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.469902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.470187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.470466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.471186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.473098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.486583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302ce2e-8e95-4889-ada3-33228cc28583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.487332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ce2e-8e95-4889-ada3-33228cc28583 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.487613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ce2e-8e95-4889-ada3-33228cc28583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.487924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ce2e-8e95-4889-ada3-33228cc28583 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.488736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ce2e-8e95-4889-ada3-33228cc28583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.490840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ce2e-8e95-4889-ada3-33228cc28583 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.497728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 774/1572] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.498521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.515884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 799/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.520256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.520545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.520824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.539252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:13.540498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:13.558925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92861-9565-48c3-8382-fac66da8d003 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.597426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 800/1574] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:13.598344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.608087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2be06-6d2a-4566-b3d2-03198ebc6afc None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.612269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6bd7e-412c-4b99-872e-5331e48a2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.612657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.612947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6bd7e-412c-4b99-872e-5331e48a2522 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.613234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6bd7e-412c-4b99-872e-5331e48a2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.613363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.613505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6bd7e-412c-4b99-872e-5331e48a2522 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.613640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.613856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.614301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6bd7e-412c-4b99-872e-5331e48a2522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.614531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.616227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6bd7e-412c-4b99-872e-5331e48a2522 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.616414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.639662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 775/1575] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.639875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 801/1576] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.639875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.641598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.642089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.642567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.649503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77c915-bb09-47c2-a9cd-d0b7e63412eb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.655842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.656634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.656837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.657083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.658387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.661604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.671895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] MFA Rules not processed for user `3bd6ea89c3584e50b6ff497428a11b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:13.673126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:13.687029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 802/1577] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.687029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.697755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a9a3-af07-4d54-80e6-5dee500cb77b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.703075 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.703745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.704151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.704446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.705133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.707103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.726794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 803/1578] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.727665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.737027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd87cd-8d17-4958-89e5-f648ca1f61f8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.741823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.742470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.742754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.743030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.743837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 776/1579] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:13.743963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.744642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.745755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.756515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75329fb-c20b-4970-bdf9-31c19e398e8a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.762051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.762743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.763022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.763319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.764572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.766502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.768971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 804/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.769873 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.786200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 777/1581] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:13 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:13.787130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.796460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c212f-be60-4bae-8502-038d8ebcaa88 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.800999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.801666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.801954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.802234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.802958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.804535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.814561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 778/1582] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.815434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.825140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743eb5f-149f-4214-b344-592ee7f7fe6b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.825695 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064db4e-eac5-45ea-b9f3-26687bce6b58 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.829791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.830438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.830688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.830816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.830980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.831530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.831888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.832181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.832897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.834516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.840484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.842159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.844766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 779/1583] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.846538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.852227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 805/1584] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:13.853115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.856339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b15c7-c1ff-49d3-ab9c-69a54634c95e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.861076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.861756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.862006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f1a36-fef5-4c75-a356-cd3a0dd20e08 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.862125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.862310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.863019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.864609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.866682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.867321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.867601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.867887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.868866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.870186 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.876172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 780/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.878987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.881108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 806/1586] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.881976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.891900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a2b2-72bd-4d9e-8ff0-006e28ec9a7f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.896705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886711-01ea-425e-8588-40736340577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.897378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886711-01ea-425e-8588-40736340577c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.897689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886711-01ea-425e-8588-40736340577c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.897967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886711-01ea-425e-8588-40736340577c admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.898684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f886711-01ea-425e-8588-40736340577c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.900301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f886711-01ea-425e-8588-40736340577c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.912426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 807/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.913050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886711-01ea-425e-8588-40736340577c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.925052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886711-01ea-425e-8588-40736340577c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.930550 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.931365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.931728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.932142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.932976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.934698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.941004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c544ef-3bcc-4cc9-80b2-d5b7df814f86 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.945144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.946094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.949486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 808/1588] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.949665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.949665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.949865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.959597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.961293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.961622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6de6f-af6c-42be-908c-a22160ae1695 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.966338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.967037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:13.967324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:13.967601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:13.968329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:13.970950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:13.971620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 781/1589] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:13.975402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.988380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 809/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:13.989456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:13.992152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0fab3-bf83-4724-92ab-9d13f4fddc34 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:13.999185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:13.999940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.000289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.000643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.002128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.002931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3523a9-770a-45fc-a898-d5dcd5e222ee admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.004873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.019177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.020250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.020804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.021111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.022445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 782/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:14.023096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.023463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.025314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.035718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e01e80-8003-4b3b-a7bf-b5240e6bbaea admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.041057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 810/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:14.042503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.045848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.046669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.046957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.047287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.048070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.049973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.061361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2c09-b1da-47ff-bbd0-d14d8c5f1de2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.064029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 783/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:14.065154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.075712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.076458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015db3-f1e2-43a2-b484-31395b1887e7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.076593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.076840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.077118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.078412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.080772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.082274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.083442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.083907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.084185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.084915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.087121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.098591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 811/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:14.099321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.112165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d960-8316-431b-bb88-2f43b837c6d8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.115642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 784/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:14.115642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.121413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.123867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.124355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.125497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] PATH_INFO: `/v3/projects/9bb35d1850b24e4099d2b4d901fa77b2/users/e3a221328cff4c6fa01e0e7673d66cb7/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.128847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7d73-f080-4e7c-93cd-6d7773355942 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.134671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.135941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.136345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.136688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] PATH_INFO: `/v3/projects/56f9e0563ca841b2acf0475664032b9f/users/4f23070cd3fc48a9be463b1bc50ecf38/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.149606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb35d1850b24e4099d2b4d901fa77b2, user_id=e3a221328cff4c6fa01e0e7673d66cb7, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.152719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.154580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f9e0563ca841b2acf0475664032b9f, user_id=4f23070cd3fc48a9be463b1bc50ecf38, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.157632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.185273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 785/1597] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:14 2022] PUT /identity/v3/projects/56f9e0563ca841b2acf0475664032b9f/users/4f23070cd3fc48a9be463b1bc50ecf38/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:14.185273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.186770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 812/1597] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:14 2022] PUT /identity/v3/projects/9bb35d1850b24e4099d2b4d901fa77b2/users/e3a221328cff4c6fa01e0e7673d66cb7/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:14.187941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.270568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881cb10-ade5-4162-bafa-bc6872fe46e7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.300039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706678c-0d34-4798-aee7-666bf8b5da54 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.305585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.306589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.307190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.307441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] PATH_INFO: `/v3/projects/14fdfd863cd446bbbef27d75ee9a4412/users/1cbd73e25e9f445893ccf89dc9135621/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.324358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fdfd863cd446bbbef27d75ee9a4412, user_id=1cbd73e25e9f445893ccf89dc9135621, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.327873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.356424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 786/1598] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:14 2022] PUT /identity/v3/projects/14fdfd863cd446bbbef27d75ee9a4412/users/1cbd73e25e9f445893ccf89dc9135621/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:14.360900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.394201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.395427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.396058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.396390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] PATH_INFO: `/v3/projects/4af9f146066048418277f36db15f3f65/users/e724e0c0897b4ac1975a3ba7d1d741f8/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.419461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af9f146066048418277f36db15f3f65, user_id=e724e0c0897b4ac1975a3ba7d1d741f8, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.423246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.440318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 813/1599] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:14 2022] PUT /identity/v3/projects/4af9f146066048418277f36db15f3f65/users/e724e0c0897b4ac1975a3ba7d1d741f8/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:14.441188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.452328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d42bf-5ae8-4efe-9736-10890d85f1d8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.517919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28176-0429-409e-bc04-c3eaa0e93fbb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.523911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406535ae-7a1e-4dcc-a385-287562792948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.524958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406535ae-7a1e-4dcc-a385-287562792948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.525357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406535ae-7a1e-4dcc-a385-287562792948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.525943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406535ae-7a1e-4dcc-a385-287562792948 admin admin] PATH_INFO: `/v3/projects/875b6351ce534b39abdd2fdf84760f1e/users/89f3193a8899452fb452311dddfe6394/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.537630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08127df-0467-4dad-94ac-edb33c36441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.538773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08127df-0467-4dad-94ac-edb33c36441c admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.539212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08127df-0467-4dad-94ac-edb33c36441c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.539648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08127df-0467-4dad-94ac-edb33c36441c admin admin] PATH_INFO: `/v3/projects/79beb8c8a2f7430f9d5011cfb455acc7/users/59ae8544d37b4de78c4164fc9de7acb4/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.546007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406535ae-7a1e-4dcc-a385-287562792948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875b6351ce534b39abdd2fdf84760f1e, user_id=89f3193a8899452fb452311dddfe6394, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.549427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406535ae-7a1e-4dcc-a385-287562792948 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.557062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08127df-0467-4dad-94ac-edb33c36441c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79beb8c8a2f7430f9d5011cfb455acc7, user_id=59ae8544d37b4de78c4164fc9de7acb4, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:14.560319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08127df-0467-4dad-94ac-edb33c36441c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:14.566975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 814/1600] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:14 2022] PUT /identity/v3/projects/875b6351ce534b39abdd2fdf84760f1e/users/89f3193a8899452fb452311dddfe6394/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:14.568489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3acb-815e-491d-80ca-d23987bf4c96 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.568909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3acb-815e-491d-80ca-d23987bf4c96 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.569287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3acb-815e-491d-80ca-d23987bf4c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.587566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 787/1601] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:14 2022] PUT /identity/v3/projects/79beb8c8a2f7430f9d5011cfb455acc7/users/59ae8544d37b4de78c4164fc9de7acb4/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:14.590558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-185d3acb-815e-491d-80ca-d23987bf4c96 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.593107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-185d3acb-815e-491d-80ca-d23987bf4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.594690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e614-3782-4eaf-8b90-bda77e325c36 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.594986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e614-3782-4eaf-8b90-bda77e325c36 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.595274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e614-3782-4eaf-8b90-bda77e325c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.648058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1372e614-3782-4eaf-8b90-bda77e325c36 None None] MFA Rules not processed for user `e3a221328cff4c6fa01e0e7673d66cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.650573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1372e614-3782-4eaf-8b90-bda77e325c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.704251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 815/1602] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:14.704251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3550-f653-4e9a-94fe-7aef3b008e21 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.724707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3550-f653-4e9a-94fe-7aef3b008e21 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.725449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3550-f653-4e9a-94fe-7aef3b008e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.747628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 788/1603] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:14.749208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f7fa-6127-4120-8c12-b498440e6eac None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.751196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f7fa-6127-4120-8c12-b498440e6eac None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.751555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f7fa-6127-4120-8c12-b498440e6eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.776746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-490f3550-f653-4e9a-94fe-7aef3b008e21 None None] MFA Rules not processed for user `1cbd73e25e9f445893ccf89dc9135621`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.778094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-490f3550-f653-4e9a-94fe-7aef3b008e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.783833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bcf1f7fa-6127-4120-8c12-b498440e6eac None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.785762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bcf1f7fa-6127-4120-8c12-b498440e6eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.793953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 789/1604] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:14.795941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.796233 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.796510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.830714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] MFA Rules not processed for user `89f3193a8899452fb452311dddfe6394`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.832158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.877763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 816/1605] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:14.882608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1114d-0bfc-4abe-b80a-e7495ad14d66 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.882902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1114d-0bfc-4abe-b80a-e7495ad14d66 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.883186 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1114d-0bfc-4abe-b80a-e7495ad14d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.907812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c9f1114d-0bfc-4abe-b80a-e7495ad14d66 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.909058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c9f1114d-0bfc-4abe-b80a-e7495ad14d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.922852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 817/1606] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:14.924040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfc96-a1f1-41bd-97b2-1b05f62492d9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.924416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfc96-a1f1-41bd-97b2-1b05f62492d9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.924808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfc96-a1f1-41bd-97b2-1b05f62492d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.929700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 790/1607] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:14.930812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:14.960125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a25cfc96-a1f1-41bd-97b2-1b05f62492d9 None None] MFA Rules not processed for user `fcace2ff87004618aa24c6cd2f457d01`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:14.961367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a25cfc96-a1f1-41bd-97b2-1b05f62492d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:14.983954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7d1f8-2376-4bf6-860a-91bf983bd05a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:14.987877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca127b-57cc-446a-a5f5-2af1f99b4797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:14.988525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca127b-57cc-446a-a5f5-2af1f99b4797 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:14.988811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca127b-57cc-446a-a5f5-2af1f99b4797 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:14.989087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca127b-57cc-446a-a5f5-2af1f99b4797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:14.998621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca127b-57cc-446a-a5f5-2af1f99b4797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.000055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca127b-57cc-446a-a5f5-2af1f99b4797 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.009289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 791/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:15.010727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80922-a0d1-4b4a-9853-2df222ff7a0f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.011024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80922-a0d1-4b4a-9853-2df222ff7a0f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.011308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80922-a0d1-4b4a-9853-2df222ff7a0f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.012718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 792/1609] 10.222.0.20 () {54 vars in 960 bytes} [Thu Apr 28 14:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:15.013382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80922-a0d1-4b4a-9853-2df222ff7a0f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.024874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80922-a0d1-4b4a-9853-2df222ff7a0f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.029197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 818/1610] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:15.030558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2d01-4d12-420f-90b1-e4e69e78d6be None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.030843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2d01-4d12-420f-90b1-e4e69e78d6be None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.031119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2d01-4d12-420f-90b1-e4e69e78d6be None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.032575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 819/1611] 10.222.0.20 () {54 vars in 960 bytes} [Thu Apr 28 14:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:15.033270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c2d01-4d12-420f-90b1-e4e69e78d6be None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.039171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.041448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.041884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.042589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.047921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c2d01-4d12-420f-90b1-e4e69e78d6be None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.052826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c90cd-d73b-4f93-b267-2b146aca1fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.053100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.053482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c90cd-d73b-4f93-b267-2b146aca1fef admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.053782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c90cd-d73b-4f93-b267-2b146aca1fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.054056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c90cd-d73b-4f93-b267-2b146aca1fef admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.054566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.054742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c90cd-d73b-4f93-b267-2b146aca1fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.056664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c90cd-d73b-4f93-b267-2b146aca1fef admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.066263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 793/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:15.067175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.075880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2badf8c-0972-4966-ac81-d54530a2c53d service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.079904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae64e8-6b42-4ec1-8247-a15596add18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.080549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae64e8-6b42-4ec1-8247-a15596add18f service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.080835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae64e8-6b42-4ec1-8247-a15596add18f service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.081115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae64e8-6b42-4ec1-8247-a15596add18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.086366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 820/1613] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:15 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:15.088166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac8419-88cc-486c-b3f4-6933b2ff8b53 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.088601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac8419-88cc-486c-b3f4-6933b2ff8b53 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.089044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac8419-88cc-486c-b3f4-6933b2ff8b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.095342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae64e8-6b42-4ec1-8247-a15596add18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.096800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae64e8-6b42-4ec1-8247-a15596add18f service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.108218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 794/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:15.109835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.110281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.110592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.113862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5bac8419-88cc-486c-b3f4-6933b2ff8b53 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:15.115737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5bac8419-88cc-486c-b3f4-6933b2ff8b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:15.135047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:15.137220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:15.220938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 821/1615] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Apr 28 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:15.222999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.223310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.223815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.239090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 795/1616] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Apr 28 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:15.240128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.243713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] MFA Rules not processed for user `fcace2ff87004618aa24c6cd2f457d01`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:15.245613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:15.337065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 822/1617] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:15.345368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.362135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761558ba-4612-429e-8ed6-8507c16afd41 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.365754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf99f-5bb4-4f90-b247-bf1dc4ea2533 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.368832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.369885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.370693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.371219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.372284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.374095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.375367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.375494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.375820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.376621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.410051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 796/1618] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:15 2022] POST /identity/v3/users => generated 308 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:15.411309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.429667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d89fd-d805-4617-9ae7-eeb787253c81 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.439649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.441102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.441644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.442043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.468010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.474741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.490542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 823/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:15.491612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.505017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce6f53-890d-4159-b546-92a65a96b71d service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.511254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.512123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.512413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.512694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.514189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.515980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.516950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.518249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.530670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 797/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:15.531876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 824/1621] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:15.536067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.548000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911028-d874-40bd-9b69-843961ad0f90 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.564654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.567864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.568365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.568808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] PATH_INFO: `/v3/projects/5a00fb2016a548af9db277957ea5cc12/users/01fe75fb441e4cd8bbabc145f49d1eef/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.589998 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a00fb2016a548af9db277957ea5cc12, user_id=01fe75fb441e4cd8bbabc145f49d1eef, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.594023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.616455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 798/1622] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:15 2022] PUT /identity/v3/projects/5a00fb2016a548af9db277957ea5cc12/users/01fe75fb441e4cd8bbabc145f49d1eef/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:15.620987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.635087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b57da-67db-4d7c-a395-2bd4dd754d9b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.745148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249d589-a39a-4154-bcc7-e5ba44e09ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.746018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d589-a39a-4154-bcc7-e5ba44e09ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.746394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d589-a39a-4154-bcc7-e5ba44e09ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.746741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d589-a39a-4154-bcc7-e5ba44e09ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.747650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249d589-a39a-4154-bcc7-e5ba44e09ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.749417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249d589-a39a-4154-bcc7-e5ba44e09ae8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.765452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 825/1623] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:15.769398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.781589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317b0c-ada9-4e24-82c3-32289141799b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:15.787518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:15.788595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.789153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.789537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] PATH_INFO: `/v3/projects/5a00fb2016a548af9db277957ea5cc12/users/01fe75fb441e4cd8bbabc145f49d1eef/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.792457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a00fb2016a548af9db277957ea5cc12, user_id=01fe75fb441e4cd8bbabc145f49d1eef, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:15.796155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:15.808638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 799/1624] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:15 2022] PUT /identity/v3/projects/5a00fb2016a548af9db277957ea5cc12/users/01fe75fb441e4cd8bbabc145f49d1eef/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:15.820299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:15.820623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:15.820910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:15.870312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] MFA Rules not processed for user `01fe75fb441e4cd8bbabc145f49d1eef`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:15.871846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:15.935676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:15.986188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 826/1625] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:16.001968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:16.075423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea3f9c-0764-44e9-a3bb-364320ea1559 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:16.081056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d4f1a-81c4-4a3a-b62d-040dfd867906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:16.081831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4f1a-81c4-4a3a-b62d-040dfd867906 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.082161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4f1a-81c4-4a3a-b62d-040dfd867906 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.082510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4f1a-81c4-4a3a-b62d-040dfd867906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.100241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9cb0-a336-494c-810a-25c431418352 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:16.106955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4f1a-81c4-4a3a-b62d-040dfd867906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:16.107531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bca31-1561-4272-8618-90c74e9b1760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:16.108676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bca31-1561-4272-8618-90c74e9b1760 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.109188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bca31-1561-4272-8618-90c74e9b1760 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.109606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4f1a-81c4-4a3a-b62d-040dfd867906 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:16.109961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bca31-1561-4272-8618-90c74e9b1760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.121859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 827/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:16.124219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78143-5c93-42d9-90fb-b12e8f95e63e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.124577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78143-5c93-42d9-90fb-b12e8f95e63e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.124920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78143-5c93-42d9-90fb-b12e8f95e63e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.131102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 828/1627] 10.222.0.20 () {54 vars in 912 bytes} [Thu Apr 28 14:09:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:16.132477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.132870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.133217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.153502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:16.155235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:16.167532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 829/1628] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:16.187712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:16.194828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bca31-1561-4272-8618-90c74e9b1760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:16.197141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bca31-1561-4272-8618-90c74e9b1760 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:16.205654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc23d-de50-4a08-b01a-938ca47aa0c2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:16.210742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 800/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:16.220152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac3ea-c827-4e51-ab0c-c7ba4dc4e913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:16.220884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac3ea-c827-4e51-ab0c-c7ba4dc4e913 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.221125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac3ea-c827-4e51-ab0c-c7ba4dc4e913 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.221352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac3ea-c827-4e51-ab0c-c7ba4dc4e913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.257515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac3ea-c827-4e51-ab0c-c7ba4dc4e913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:16.259508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac3ea-c827-4e51-ab0c-c7ba4dc4e913 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:16.279102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 830/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:16.387306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d2e3-79c7-45a1-9fb5-d6debaeaff41 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.387800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d2e3-79c7-45a1-9fb5-d6debaeaff41 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.387982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d2e3-79c7-45a1-9fb5-d6debaeaff41 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.390413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 801/1631] 10.222.0.20 () {54 vars in 912 bytes} [Thu Apr 28 14:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:16.395860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.396592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.397068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.427889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:16.437834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:16.460441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 831/1632] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:16.479630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d2e3-79c7-45a1-9fb5-d6debaeaff41 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:16.485044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eae4d2e3-79c7-45a1-9fb5-d6debaeaff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:16.580458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d2e3-79c7-45a1-9fb5-d6debaeaff41 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:16.587859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4a5e-b1a4-4650-8dd4-373faf0abd5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:16.590685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4a5e-b1a4-4650-8dd4-373faf0abd5b service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.591057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4a5e-b1a4-4650-8dd4-373faf0abd5b service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.592627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4a5e-b1a4-4650-8dd4-373faf0abd5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.628265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:16.630972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b4a5e-b1a4-4650-8dd4-373faf0abd5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:16.632826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b4a5e-b1a4-4650-8dd4-373faf0abd5b service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:16.646875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 802/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:16.750504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219022bf-38c9-454e-8677-e024b6cf8329 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:16.764492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:16.765870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.766339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.766781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] PATH_INFO: `/v3/users/89f3193a8899452fb452311dddfe6394` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:16.769445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f3193a8899452fb452311dddfe6394)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:16.775097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:16.898425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f3193a8899452fb452311dddfe6394'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:16.938944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f3193a8899452fb452311dddfe6394'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:16.954102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f3193a8899452fb452311dddfe6394'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:16.954831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f3193a8899452fb452311dddfe6394'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:16.972657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f3193a8899452fb452311dddfe6394'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:16.992736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 832/1634] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:16 2022] DELETE /identity/v3/users/89f3193a8899452fb452311dddfe6394 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:16.997164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:16.997718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:16.998209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:17.037421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:17.039352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:17.208033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 803/1635] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:17.241694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:17.243651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:17.377975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52ee63-329a-4df8-bcbc-2c52890401b3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:17.380424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cea22e-01ba-405d-9f8e-97461d1d1199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:17.380773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:17.382691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cea22e-01ba-405d-9f8e-97461d1d1199 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:17.382813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cea22e-01ba-405d-9f8e-97461d1d1199 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:17.383036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cea22e-01ba-405d-9f8e-97461d1d1199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:17.384591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:17.400932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27571-184d-46a1-b16b-4125dfd9301a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:17.402793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cea22e-01ba-405d-9f8e-97461d1d1199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:17.405783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cea22e-01ba-405d-9f8e-97461d1d1199 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:17.410449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:17.412027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:17.412518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:17.413016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] PATH_INFO: `/v3/users/e3a221328cff4c6fa01e0e7673d66cb7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:17.414556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a221328cff4c6fa01e0e7673d66cb7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:17.416372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:09:17.416372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 28 14:09:17.416372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: Apr 28 14:09:17.418727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:17.431873 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 833/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:17.550639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a221328cff4c6fa01e0e7673d66cb7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:17.577702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a221328cff4c6fa01e0e7673d66cb7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:17.579275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a221328cff4c6fa01e0e7673d66cb7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:17.636834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a221328cff4c6fa01e0e7673d66cb7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:17.656789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a221328cff4c6fa01e0e7673d66cb7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:17.673626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 804/1637] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:17 2022] DELETE /identity/v3/users/e3a221328cff4c6fa01e0e7673d66cb7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:17.678171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670030-3abd-4b5b-bff8-c47b354db393 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:17.678662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670030-3abd-4b5b-bff8-c47b354db393 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:17.678744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670030-3abd-4b5b-bff8-c47b354db393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:17.715944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-81670030-3abd-4b5b-bff8-c47b354db393 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:17.720098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-81670030-3abd-4b5b-bff8-c47b354db393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:17.839388 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 834/1638] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:17.913438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:17.915758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:17.952365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f203c-083c-41e8-a848-204d9bae2f02 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:17.953285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f203c-083c-41e8-a848-204d9bae2f02 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:17.953811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f203c-083c-41e8-a848-204d9bae2f02 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:17.956236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 835/1639] 10.222.0.20 () {54 vars in 912 bytes} [Thu Apr 28 14:09:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:09:17.963808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:17.964752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:17.965231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:18.031494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:18.033249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:18.133114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 836/1640] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:09:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:18.204006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:18.205525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:18.226498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9742f4-2490-4b82-b5d0-ef3d877c656c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:18.253523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:18.255140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:18.258856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:18.262380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:18.281936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a791-cc19-4ba7-b0e1-1d647273769b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:18.284576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:18.294305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:18.297140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:18.298053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:18.298442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:18.299004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:18.314581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 837/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:18.322251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:18.324552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:18.337302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 805/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:18.625591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:18.627391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:18.667292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0f35-dcaa-4f04-95fd-428c62ed316a service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:18.685724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:18.688799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:18.688799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:18.688799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] PATH_INFO: `/v3/projects/875b6351ce534b39abdd2fdf84760f1e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:18.692802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875b6351ce534b39abdd2fdf84760f1e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:18.692802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 14:09:18.692802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 28 14:09:18.692802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: Apr 28 14:09:18.692802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:18.859463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875b6351ce534b39abdd2fdf84760f1e', 'request_id': 'req-5ea2803c-91a3-44f1-8b70-afef8630efb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:18.875832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875b6351ce534b39abdd2fdf84760f1e', 'request_id': 'req-5ea2803c-91a3-44f1-8b70-afef8630efb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:18.903402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875b6351ce534b39abdd2fdf84760f1e', 'request_id': 'req-5ea2803c-91a3-44f1-8b70-afef8630efb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:18.928455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] The token cache is being invalidate because project 875b6351ce534b39abdd2fdf84760f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:18.928845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:18.929994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:18.936232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 838/1643] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:18 2022] DELETE /identity/v3/projects/875b6351ce534b39abdd2fdf84760f1e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:18.944177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:18.961884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0cacd-2cc4-4c6f-80a9-9b8e5a52a741 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:19.089797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:19.090705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:19.090971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:19.091974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] PATH_INFO: `/v3/users/01fe75fb441e4cd8bbabc145f49d1eef` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:19.094957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fe75fb441e4cd8bbabc145f49d1eef)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:19.097078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:19.195542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fe75fb441e4cd8bbabc145f49d1eef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:19.230687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fe75fb441e4cd8bbabc145f49d1eef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:19.231849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fe75fb441e4cd8bbabc145f49d1eef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:19.247536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fe75fb441e4cd8bbabc145f49d1eef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:19.267863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fe75fb441e4cd8bbabc145f49d1eef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:19.283312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 806/1644] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:18 2022] DELETE /identity/v3/users/01fe75fb441e4cd8bbabc145f49d1eef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:19.753586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:19.755698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:19.791767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2803c-91a3-44f1-8b70-afef8630efb6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:19.929042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:19.930671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:19.931112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:19.931665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] PATH_INFO: `/v3/users/1cbd73e25e9f445893ccf89dc9135621` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:19.933958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cbd73e25e9f445893ccf89dc9135621)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:19.936878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:19.938633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:19.940725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:20.057311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cbd73e25e9f445893ccf89dc9135621'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:20.137860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cbd73e25e9f445893ccf89dc9135621'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:20.159006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f36a-a47a-485a-9fe8-09f63f458181 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:20.183331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cbd73e25e9f445893ccf89dc9135621'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:20.186059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cbd73e25e9f445893ccf89dc9135621'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:20.186211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:20.186779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:20.187055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:20.189768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:20.196855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:20.204655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-78c7b6cf-065c-4d44-a818-12e3ed03ce62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cbd73e25e9f445893ccf89dc9135621'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:20.241200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 839/1645] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:19 2022] DELETE /identity/v3/users/1cbd73e25e9f445893ccf89dc9135621 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:20.251298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:20.253330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:20.254030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:20.270853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:20.272491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:20.320642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 807/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:20.365883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:20.380658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:20.503983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 840/1647] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:20.540035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:20.541706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:20.752424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e8531-7659-4fa3-8d6b-104a17dd9dc9 service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:20.889280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:20.895815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:20.896111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:20.896393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:20.928248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:20.931099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:20.957657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 808/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:21.979264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:21.985213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.006744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff5e6-7af1-4ec2-8352-ef3b8c37e655 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:22.023323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:22.029113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.029542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.032348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] PATH_INFO: `/v3/projects/9bb35d1850b24e4099d2b4d901fa77b2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.033891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb35d1850b24e4099d2b4d901fa77b2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:22.042314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:22.132156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:22.133748 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.161258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c285e6-5d50-461a-a969-21ac51b2e44a service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:22.203447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:22.204564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.206116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.207821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] PATH_INFO: `/v3/projects/5a00fb2016a548af9db277957ea5cc12` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.211073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a00fb2016a548af9db277957ea5cc12)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:22.216134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:22.221213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb35d1850b24e4099d2b4d901fa77b2', 'request_id': 'req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.251257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb35d1850b24e4099d2b4d901fa77b2', 'request_id': 'req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.273790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb35d1850b24e4099d2b4d901fa77b2', 'request_id': 'req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.305643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] The token cache is being invalidate because project 9bb35d1850b24e4099d2b4d901fa77b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:22.306542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.308609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.317589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 841/1649] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:21 2022] DELETE /identity/v3/projects/9bb35d1850b24e4099d2b4d901fa77b2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:22.317589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:22.321625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.383087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a00fb2016a548af9db277957ea5cc12', 'request_id': 'req-2571b647-f3c5-432e-b5ef-db5f6f498ad9'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.404865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a00fb2016a548af9db277957ea5cc12', 'request_id': 'req-2571b647-f3c5-432e-b5ef-db5f6f498ad9'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.417760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a00fb2016a548af9db277957ea5cc12', 'request_id': 'req-2571b647-f3c5-432e-b5ef-db5f6f498ad9'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.450856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] The token cache is being invalidate because project 5a00fb2016a548af9db277957ea5cc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:22.451148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.458665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2571b647-f3c5-432e-b5ef-db5f6f498ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.460808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 809/1650] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:22 2022] DELETE /identity/v3/projects/5a00fb2016a548af9db277957ea5cc12 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:22.466768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9d7d-60e0-4983-b313-19ba6f72336e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.468362 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9d7d-60e0-4983-b313-19ba6f72336e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.468777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9d7d-60e0-4983-b313-19ba6f72336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.479430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b576d-c6de-44dc-a2aa-7c0052d780d3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:22.519411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-42dd9d7d-60e0-4983-b313-19ba6f72336e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:22.521194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-42dd9d7d-60e0-4983-b313-19ba6f72336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.610408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 810/1651] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:22.611919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f16a0-3f87-4641-ad95-170ac1ede2d9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.612332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f16a0-3f87-4641-ad95-170ac1ede2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.612870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f16a0-3f87-4641-ad95-170ac1ede2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.630928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:22.632032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.632145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.632357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] PATH_INFO: `/v3/projects/14fdfd863cd446bbbef27d75ee9a4412` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.638816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a53f16a0-3f87-4641-ad95-170ac1ede2d9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:22.640481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a53f16a0-3f87-4641-ad95-170ac1ede2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.640591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fdfd863cd446bbbef27d75ee9a4412)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:22.651656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:22.652380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 811/1652] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:22.654397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956526-3f22-4c24-add6-9711d1aa6f04 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.654808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956526-3f22-4c24-add6-9711d1aa6f04 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.655199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956526-3f22-4c24-add6-9711d1aa6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.680563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7d956526-3f22-4c24-add6-9711d1aa6f04 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:22.682058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7d956526-3f22-4c24-add6-9711d1aa6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.707602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 812/1653] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:22.715015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81f7f-f9cd-48e2-9a0d-07dc05d1fb26 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:22.715531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81f7f-f9cd-48e2-9a0d-07dc05d1fb26 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:22.721976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81f7f-f9cd-48e2-9a0d-07dc05d1fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:22.815923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-71e81f7f-f9cd-48e2-9a0d-07dc05d1fb26 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:22.817159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-71e81f7f-f9cd-48e2-9a0d-07dc05d1fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:22.832239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fdfd863cd446bbbef27d75ee9a4412', 'request_id': 'req-26049d97-da43-49d6-b05d-82a3a55ca95a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.869365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fdfd863cd446bbbef27d75ee9a4412', 'request_id': 'req-26049d97-da43-49d6-b05d-82a3a55ca95a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.891593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fdfd863cd446bbbef27d75ee9a4412', 'request_id': 'req-26049d97-da43-49d6-b05d-82a3a55ca95a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.932977 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] The token cache is being invalidate because project 14fdfd863cd446bbbef27d75ee9a4412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:22.933928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.935994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:22.940382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 842/1654] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:22 2022] DELETE /identity/v3/projects/14fdfd863cd446bbbef27d75ee9a4412 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:22.941274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:22.952347 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:23.080229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 813/1655] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:23.081789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.084541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.084846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.126341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049d97-da43-49d6-b05d-82a3a55ca95a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.147153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.148216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.148216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.148416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.149138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:23.149480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.151167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.172572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:23.177356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:23.193053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 843/1656] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:23.193960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.214283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 814/1657] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:23.216845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.237307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f5304-9782-40c0-872d-62d616ca304e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.246401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5a41b-7668-45ac-9f04-70c476af42f8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.251166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.251886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.252022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.257358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.258223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:23.258544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.259078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.261143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.262575 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.264655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.265682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.266799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d7e8-b1ce-4c05-9f12-af0af1afd2bc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.271705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.313156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 844/1658] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:23.314535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.314825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.315105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.354961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 815/1659] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:23.363408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.369207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:23.371868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:23.598385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493366c6-ab3e-4a85-831f-1b0a1d3377e8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.605085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.606068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.606450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.606750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.607528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.609470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.643447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 845/1660] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:23.647276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.661238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 816/1661] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/projects => generated 405 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:23.662359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.691688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c3fb-6445-4e12-815d-2851d8154f27 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.804370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b1772-b18a-402d-93c9-66d7c6d3763b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.814878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.816041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.816041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.816640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.817660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:23.819183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.824966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.846382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 817/1662] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:23.847349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.854032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.854820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.855193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.855547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.856409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.859044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.861319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f651cc-b6a7-4850-a7b5-813275eb14cd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.867953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.872104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.873056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.873413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.874994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.878685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.907556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 846/1663] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:23.908328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.921608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 818/1664] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/users => generated 303 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:23.922765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:23.933891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb9fcd-403a-41c9-b139-7bc1ad04505e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.938143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fc36-7e35-43e9-bd9e-0a912bc21136 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:23.947552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.948763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.949057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.949337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.950150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.952193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:23.960161 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:23.961181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:23.964466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:23.964989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:23.966042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:23.969801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.005139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 819/1665] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:24.007147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.009271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 847/1666] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:23 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:24.010215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.026992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ba81d-e41a-49c1-bb6b-f749edc96c78 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.154205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ddc8b-8a31-4ec8-9f8b-dc5f22c1ca3b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.164372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.165719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.166602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.167406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.170213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.170998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed267b-0c44-4b43-8d76-1aa147e25300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.173518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.174390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed267b-0c44-4b43-8d76-1aa147e25300 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.174773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed267b-0c44-4b43-8d76-1aa147e25300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.175146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed267b-0c44-4b43-8d76-1aa147e25300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.176281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed267b-0c44-4b43-8d76-1aa147e25300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.179814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed267b-0c44-4b43-8d76-1aa147e25300 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.200557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 820/1667] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:24.201917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.209612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 848/1668] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:24.211295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a511f-2766-46e9-a230-839d29f5254f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.211850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a511f-2766-46e9-a230-839d29f5254f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.212321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a511f-2766-46e9-a230-839d29f5254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.226895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b169146-3cb4-4374-b2dc-01175a4762ac admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.245707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.246668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.247186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.247678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.248617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.251571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.258775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-261a511f-2766-46e9-a230-839d29f5254f None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:24.264558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-261a511f-2766-46e9-a230-839d29f5254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:24.301526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 821/1669] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:24 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:24.303621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.363775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd8ad-84fa-43af-a4d1-3b14aa870613 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.386332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.387024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.387307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.387584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.388360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.393924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.408378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 822/1670] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:24.410824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.422081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea2b6-ed35-4f58-b384-72d6b6594704 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.431158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.432313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.433507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.434304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] PATH_INFO: `/v3/projects/5ae8db6fef4c472db290c2be42e944de/users/8c3d3829976a498f82c3bbca5b34ba67/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.457241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 849/1671] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:24.460454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a511f-2766-46e9-a230-839d29f5254f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.475922 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae8db6fef4c472db290c2be42e944de, user_id=8c3d3829976a498f82c3bbca5b34ba67, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.481191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.493336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a511f-2766-46e9-a230-839d29f5254f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.501192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d41cb-2633-4030-8712-a464892ce875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.502253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d41cb-2633-4030-8712-a464892ce875 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.502795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d41cb-2633-4030-8712-a464892ce875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.503252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d41cb-2633-4030-8712-a464892ce875 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.504386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d41cb-2633-4030-8712-a464892ce875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.506904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d41cb-2633-4030-8712-a464892ce875 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.526431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 823/1672] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:24 2022] PUT /identity/v3/projects/5ae8db6fef4c472db290c2be42e944de/users/8c3d3829976a498f82c3bbca5b34ba67/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:24.527462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.555729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 850/1673] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:24.567044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f5091-73c2-45cb-a728-939cedfef7a2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.567044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f5091-73c2-45cb-a728-939cedfef7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.568331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f5091-73c2-45cb-a728-939cedfef7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.621877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-665f5091-73c2-45cb-a728-939cedfef7a2 None None] MFA Rules not processed for user `8c3d3829976a498f82c3bbca5b34ba67`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:24.624288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-665f5091-73c2-45cb-a728-939cedfef7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:24.647892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07b19-1f92-47a1-a80d-282a136cf786 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.658653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.661317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.663241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.663241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] PATH_INFO: `/v3/projects/1f0feef57b7644cc9c2f67de4c551c75/users/fd16286a572242c99b780b205045c2fb/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.710416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0feef57b7644cc9c2f67de4c551c75, user_id=fd16286a572242c99b780b205045c2fb, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.715027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.737659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 824/1674] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:24 2022] PUT /identity/v3/projects/1f0feef57b7644cc9c2f67de4c551c75/users/fd16286a572242c99b780b205045c2fb/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:24.739345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:24.792332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 851/1675] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:24.794010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.794881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.794881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.861492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] MFA Rules not processed for user `4f23070cd3fc48a9be463b1bc50ecf38`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:24.864229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:24.897204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a93209-4f63-4a13-ae3f-6ddf32f5343a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:24.908592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b3ba5-900c-46b0-895e-3484410e1bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:24.909654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3ba5-900c-46b0-895e-3484410e1bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.911343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3ba5-900c-46b0-895e-3484410e1bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.911865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3ba5-900c-46b0-895e-3484410e1bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.912617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b3ba5-900c-46b0-895e-3484410e1bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:24.917128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b3ba5-900c-46b0-895e-3484410e1bb9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:24.947141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 825/1676] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:24.949926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:24.949926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:24.949926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:24.987594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:24.989111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:24.998436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 852/1677] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:24.999810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.005215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 826/1678] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:25.013746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.017535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:25.023750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4faff8-0e55-466e-97e4-dd21894cf301 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.032114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.032859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.033176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.033451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.034874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.037167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.098622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 853/1679] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:24 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:25.104541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.118428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da1d8a-a679-43ba-aaf9-cc84b58e3172 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.187702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570af96-ee88-4a8f-9745-0ed6b7201027 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.191563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.191975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.192087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.192365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.193306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6343e4-a41c-4c3e-b043-0b1ffbde30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.196150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6343e4-a41c-4c3e-b043-0b1ffbde30aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.196724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6343e4-a41c-4c3e-b043-0b1ffbde30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.197085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6343e4-a41c-4c3e-b043-0b1ffbde30aa admin admin] PATH_INFO: `/v3/projects/28133c1cf54442b5a4e5019ba2d5811c/users/cee838d1829c4005a98c19b15fa7d6c6/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.216537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6343e4-a41c-4c3e-b043-0b1ffbde30aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=28133c1cf54442b5a4e5019ba2d5811c, user_id=cee838d1829c4005a98c19b15fa7d6c6, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.219788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6343e4-a41c-4c3e-b043-0b1ffbde30aa admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.236285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 854/1680] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:25 2022] PUT /identity/v3/projects/28133c1cf54442b5a4e5019ba2d5811c/users/cee838d1829c4005a98c19b15fa7d6c6/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:25.238415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.238706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.238982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.266101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] MFA Rules not processed for user `4f23070cd3fc48a9be463b1bc50ecf38`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:25.267660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:25.274823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.278365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.295550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 827/1681] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:09:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:09:25.296507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.298000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:25.359888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 855/1682] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:25.361327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.468270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212777-363b-4f03-b2ed-dcdaa3bdb583 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.476368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5f1a5-56a8-48d3-96cc-9a0f3102f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.477523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5f1a5-56a8-48d3-96cc-9a0f3102f6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.477724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5f1a5-56a8-48d3-96cc-9a0f3102f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.478050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5f1a5-56a8-48d3-96cc-9a0f3102f6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.479059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5f1a5-56a8-48d3-96cc-9a0f3102f6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.481299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5f1a5-56a8-48d3-96cc-9a0f3102f6a9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.513701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 856/1683] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:25 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:25.515246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.515735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.516269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.525068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d9a9-2948-442e-9229-bfa94c55e713 service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.569840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] MFA Rules not processed for user `cee838d1829c4005a98c19b15fa7d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:25.572857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:25.650210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.650890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.652153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.652153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.681705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.684561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.721387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 828/1684] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:25.721387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.721698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 857/1685] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:25.721698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.723484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:25.743061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcb7ba-201e-41bc-b505-d82dc9314d81 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.749225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.750128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.750512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.750925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.751948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.756688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.789105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 858/1686] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:25.790258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.815728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b89e7-e942-4fff-b247-029fde518930 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:25.836106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:25.836857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:25.837134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:25.837734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:25.847753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:25.853288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:25.945797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 859/1687] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:25 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:25.949789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:25.950617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd980c-36ea-482c-ab00-f15def859bba service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.196151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a8ff-eabe-44a2-993d-83eadb9272ce admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.210768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:26.212952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:26.214007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.214348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.214630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.215871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.216230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.216480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] PATH_INFO: `/v3/projects/b4598bdefb384e479bf1f2af07a19b33/users/71d697e1464947a1900018d9496753a0/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.258192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4598bdefb384e479bf1f2af07a19b33, user_id=71d697e1464947a1900018d9496753a0, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:26.261129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:26.294477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 860/1688] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:25 2022] PUT /identity/v3/projects/b4598bdefb384e479bf1f2af07a19b33/users/71d697e1464947a1900018d9496753a0/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:26.297183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:26.561388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:26.561388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:26.561388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 829/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:26.561388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:26.561388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964fe41-f73b-4312-846c-46d150a74b20 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.563463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809184-ecbb-4e7f-9150-412a36a8c50c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.563463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:26.563463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.563463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.564693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.564693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:26.564693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:26.567658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:26.567658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.567658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.567658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.568886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:26.568886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:26.568886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 830/1690] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:26.587964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 861/1691] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:26 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:26.593293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:26.594525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:26.612219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadf775-877a-4afd-88e5-5a6c0f03261c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.617491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d67128-cd09-41b1-baaf-28d70fd33941 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.625382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:26.626581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.627195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.628092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.629703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:26.632086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4695be-5373-4e88-8dcb-aedbaa287463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:26.633471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4695be-5373-4e88-8dcb-aedbaa287463 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.635193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:26.635717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4695be-5373-4e88-8dcb-aedbaa287463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.636359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4695be-5373-4e88-8dcb-aedbaa287463 admin admin] PATH_INFO: `/v3/projects/b4598bdefb384e479bf1f2af07a19b33/users/71d697e1464947a1900018d9496753a0/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.641855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4695be-5373-4e88-8dcb-aedbaa287463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4598bdefb384e479bf1f2af07a19b33, user_id=71d697e1464947a1900018d9496753a0, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:26.648498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4695be-5373-4e88-8dcb-aedbaa287463 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:26.666391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 862/1692] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:26.667889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:26.679417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 831/1693] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:26 2022] PUT /identity/v3/projects/b4598bdefb384e479bf1f2af07a19b33/users/71d697e1464947a1900018d9496753a0/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:26.699276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:26.700733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:26.701411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:26.717762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbb304-9eda-443d-bf71-9947bc98b0ea admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:26.843412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] MFA Rules not processed for user `71d697e1464947a1900018d9496753a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:26.845450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:27.017849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 832/1694] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:27.031909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:27.034541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:27.041287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:27.047438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.047823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.049498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] PATH_INFO: `/v3/projects/9a5da827bb0b48db9792d559e15da0ef/users/3e1c4974296745e99b76145e5cade1d2/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.124227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5da827bb0b48db9792d559e15da0ef, user_id=3e1c4974296745e99b76145e5cade1d2, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:27.129740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:27.177339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 863/1695] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:26 2022] PUT /identity/v3/projects/9a5da827bb0b48db9792d559e15da0ef/users/3e1c4974296745e99b76145e5cade1d2/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:27.180700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:27.190457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:27.222349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7ffb-bd9d-49ed-bf64-5e5199e1e9f7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:27.348831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:27.350204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.351508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.351898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.418228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a21840-8e66-4d54-b23c-ecf08ab29935 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:27.442515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:27.443559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.443935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.444270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] PATH_INFO: `/v3/users/3bd6ea89c3584e50b6ff497428a11b6d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.445894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd6ea89c3584e50b6ff497428a11b6d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:27.453820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:27.542976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:27.549588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:27.584070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 833/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:27.589165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:27.617614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1aaf-0e52-40e9-a270-d6f069d7cb30 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:27.627243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617facda-cccb-437e-ad55-3938fa0a80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:27.629314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617facda-cccb-437e-ad55-3938fa0a80eb admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.630206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617facda-cccb-437e-ad55-3938fa0a80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.631291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617facda-cccb-437e-ad55-3938fa0a80eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.632811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617facda-cccb-437e-ad55-3938fa0a80eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:27.637139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617facda-cccb-437e-ad55-3938fa0a80eb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:27.651984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd6ea89c3584e50b6ff497428a11b6d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:27.675697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 834/1697] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:27.677733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bcc74-a089-4919-b727-dfbcf23113f7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.684064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bcc74-a089-4919-b727-dfbcf23113f7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.684064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bcc74-a089-4919-b727-dfbcf23113f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.707613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fd5bcc74-a089-4919-b727-dfbcf23113f7 None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:27.709483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fd5bcc74-a089-4919-b727-dfbcf23113f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:27.736471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd6ea89c3584e50b6ff497428a11b6d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:27.768263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd6ea89c3584e50b6ff497428a11b6d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:27.771261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd6ea89c3584e50b6ff497428a11b6d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:27.812131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbc22e55-ad02-4e9a-9355-a8ff5e5a6161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd6ea89c3584e50b6ff497428a11b6d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:27.831010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 835/1698] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Apr 28 14:09:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:27.836900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1832b-7384-4c0c-9ada-ae71180e4c7d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.838142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1832b-7384-4c0c-9ada-ae71180e4c7d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.839243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1832b-7384-4c0c-9ada-ae71180e4c7d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.846699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 836/1699] 10.222.0.20 () {54 vars in 912 bytes} [Thu Apr 28 14:09:27 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:27.848372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1832b-7384-4c0c-9ada-ae71180e4c7d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:27.853355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2ba1832b-7384-4c0c-9ada-ae71180e4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:27.861807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 864/1700] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:27 2022] DELETE /identity/v3/users/3bd6ea89c3584e50b6ff497428a11b6d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:27.863541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbcf32-834d-40de-adbb-7c52610b2212 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:27.868822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbcf32-834d-40de-adbb-7c52610b2212 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:27.870961 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbcf32-834d-40de-adbb-7c52610b2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:27.951403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d5dbcf32-834d-40de-adbb-7c52610b2212 None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:27.958463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d5dbcf32-834d-40de-adbb-7c52610b2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.078913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1832b-7384-4c0c-9ada-ae71180e4c7d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:28.097818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:28.109407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.110289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.111607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] PATH_INFO: `/v3/projects/9a5da827bb0b48db9792d559e15da0ef/users/3e1c4974296745e99b76145e5cade1d2/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.116608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5da827bb0b48db9792d559e15da0ef, user_id=3e1c4974296745e99b76145e5cade1d2, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:28.132199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:28.138785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 865/1701] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:09:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:28.141688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.141932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.142334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.187394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:28.191890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.198406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 837/1702] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:27 2022] PUT /identity/v3/projects/9a5da827bb0b48db9792d559e15da0ef/users/3e1c4974296745e99b76145e5cade1d2/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:28.199176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:28.201789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.391772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 866/1703] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:28.392773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:28.397100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf017-dafa-4c9e-8563-31354ff74c88 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:28.398400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.407300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:28.408125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.408508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.408887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.414756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.539611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6582-2448-4b73-b553-306994c36f23 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:28.562336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26e357-ef87-4d2c-80ac-7b4d44cd4f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:28.563746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26e357-ef87-4d2c-80ac-7b4d44cd4f15 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.564154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26e357-ef87-4d2c-80ac-7b4d44cd4f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.564608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26e357-ef87-4d2c-80ac-7b4d44cd4f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.574763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26e357-ef87-4d2c-80ac-7b4d44cd4f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:28.576504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26e357-ef87-4d2c-80ac-7b4d44cd4f15 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:28.589433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 867/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:28.591378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.591762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.592151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.615448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:28.617668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:28.629059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] MFA Rules not processed for user `3e1c4974296745e99b76145e5cade1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:28.630468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.652601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 838/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:28.654541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:28.674466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37a25-6e6d-490e-ae95-531835a2533d service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:28.685431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:28.686581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.686961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.687346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.728283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:28.730052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:28.767750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 839/1706] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:28.778581 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:28.780629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.813690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 868/1707] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:28.826955 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf026f5-4c39-4527-8666-e7667d83dedb service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:28.827364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:28.834535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:28.845321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:28.856221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.856660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.857207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.878396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aea9aa-ca84-4cc9-93d9-f26db30a0a34 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:28.890515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:28.898632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:28.899728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9324f8-b325-4b6a-9321-2623b963b00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:28.900698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9324f8-b325-4b6a-9321-2623b963b00a service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:28.901395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9324f8-b325-4b6a-9321-2623b963b00a service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:28.902729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9324f8-b325-4b6a-9321-2623b963b00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:28.932312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 840/1708] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:28.949332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9324f8-b325-4b6a-9321-2623b963b00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:28.951729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9324f8-b325-4b6a-9321-2623b963b00a service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:29.011181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 869/1709] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:29.824109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:29.855016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f59712-04dc-493f-84f4-faa6c7153602 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:29.882266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:29.883578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:29.884073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:29.884550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] PATH_INFO: `/v3/users/cee838d1829c4005a98c19b15fa7d6c6` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:29.889230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee838d1829c4005a98c19b15fa7d6c6)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:29.891381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:30.057320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee838d1829c4005a98c19b15fa7d6c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:30.115814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee838d1829c4005a98c19b15fa7d6c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:30.118764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee838d1829c4005a98c19b15fa7d6c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:30.163916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee838d1829c4005a98c19b15fa7d6c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:30.173670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee838d1829c4005a98c19b15fa7d6c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:30.180739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 841/1710] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:29 2022] DELETE /identity/v3/users/cee838d1829c4005a98c19b15fa7d6c6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:30.186252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:30.186749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:30.186835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:30.254287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:30.286097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:30.521433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 870/1711] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:30.550020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:30.551501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:30.738186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a911688-2f6f-4be8-8c96-e47f55b9501d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:30.756872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d4f81-ff91-4381-add0-985fb54e906f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:30.757593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4f81-ff91-4381-add0-985fb54e906f service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:30.757876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4f81-ff91-4381-add0-985fb54e906f service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:30.758151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4f81-ff91-4381-add0-985fb54e906f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:30.769826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d4f81-ff91-4381-add0-985fb54e906f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:30.771496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d4f81-ff91-4381-add0-985fb54e906f service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:30.791119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 842/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:30.829376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:30.831088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:30.875725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acdca7-3981-483a-a528-6ecdb5312f71 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:30.928657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:30.929575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:30.929855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:30.930130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] PATH_INFO: `/v3/projects/657e313ac1b74d0abb25c21e17c7b96b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:30.935084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=657e313ac1b74d0abb25c21e17c7b96b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:30.944922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:31.223014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97dfe6-c61b-4466-9cb9-ff309a97191c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:31.223626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97dfe6-c61b-4466-9cb9-ff309a97191c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:31.223944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97dfe6-c61b-4466-9cb9-ff309a97191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:31.253830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657e313ac1b74d0abb25c21e17c7b96b', 'request_id': 'req-0802a1a4-46f5-4894-a74f-8935e79b7e7a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:31.294269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2f97dfe6-c61b-4466-9cb9-ff309a97191c None None] MFA Rules not processed for user `fd16286a572242c99b780b205045c2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:31.297760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2f97dfe6-c61b-4466-9cb9-ff309a97191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:31.299397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657e313ac1b74d0abb25c21e17c7b96b', 'request_id': 'req-0802a1a4-46f5-4894-a74f-8935e79b7e7a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:31.333417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657e313ac1b74d0abb25c21e17c7b96b', 'request_id': 'req-0802a1a4-46f5-4894-a74f-8935e79b7e7a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:31.388021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] The token cache is being invalidate because project 657e313ac1b74d0abb25c21e17c7b96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:31.391441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:31.394737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0802a1a4-46f5-4894-a74f-8935e79b7e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:31.399271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 871/1713] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:30 2022] DELETE /identity/v3/projects/657e313ac1b74d0abb25c21e17c7b96b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:31.405787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9977a-4a83-4add-9574-16878981265b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:31.410471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9977a-4a83-4add-9574-16878981265b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:31.412038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9977a-4a83-4add-9574-16878981265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:31.511008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fef9977a-4a83-4add-9574-16878981265b None None] MFA Rules not processed for user `4f23070cd3fc48a9be463b1bc50ecf38`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:31.512258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fef9977a-4a83-4add-9574-16878981265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:31.567429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 843/1714] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:31.569061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8667-883c-458d-8199-b21e6289928e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:31.569453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8667-883c-458d-8199-b21e6289928e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:31.569921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8667-883c-458d-8199-b21e6289928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:31.631344 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-853b8667-883c-458d-8199-b21e6289928e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:31.635842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-853b8667-883c-458d-8199-b21e6289928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:31.721239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 872/1715] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:31.735602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9977a-4a83-4add-9574-16878981265b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:31.738179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fef9977a-4a83-4add-9574-16878981265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:31.786298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 844/1716] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:31.792896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:31.793665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:31.794110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:31.866688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:31.880323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:31.921236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 845/1717] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:31.925605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:31.952767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d31a5-205a-409e-8ed1-74ac4de96caa None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:31.958628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:31.959407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:31.959792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:31.960169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:31.961206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:31.961441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:31.963218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:31.969671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9977a-4a83-4add-9574-16878981265b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:31.989943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:31.990640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:31.990922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:31.991195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:31.991898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:31.994073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.001246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 846/1718] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:32.002533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.021759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb97f-95bd-4d16-a4d8-7549eee1f9c0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.039487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.041201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.041541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.041950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.042800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.045748 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.061894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 873/1719] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:31 2022] POST /identity/v3/projects => generated 403 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:32.064893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.126718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 847/1720] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:32 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:32.130605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.245793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e1bac-d872-406f-956c-5df0eb4dd1a7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.304012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821493b0-d9eb-4967-8e8f-6c9158edc9bf admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.330038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.330901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.331343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.331727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.332540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.344996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.380077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.381436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.381989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.382454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.383633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.389591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.424458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 848/1721] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:32 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:32.428678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.441298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 874/1722] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:32 2022] POST /identity/v3/users => generated 308 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:32.443698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.456104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ebe0-509e-4973-83c9-f20aaf54c55e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.474252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3084-d5b1-4d6d-8242-c3640c7da97f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.476698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.477572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.478109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.478978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.480449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.484532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.489385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.490312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.490959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.491518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.492453 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.494345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.508471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 849/1723] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:09:32.513061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.538281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 875/1724] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:32.540322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.558147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017937-e5ee-4dbe-b34c-711b441606ac admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.566156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392e63a-74f5-4010-9305-43de9672abeb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.584975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.587008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.588410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.588902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] PATH_INFO: `/v3/projects/9d1fc4ad017d48b6b471ffa9a66aacff/users/bb3cc7a27ebe431cbd0efe26ab808c77/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.592632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.593322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.593628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.593911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.594641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.596245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.630352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1fc4ad017d48b6b471ffa9a66aacff, user_id=bb3cc7a27ebe431cbd0efe26ab808c77, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.637006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.643533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 850/1725] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:32.649048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.688282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 876/1726] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:32 2022] PUT /identity/v3/projects/9d1fc4ad017d48b6b471ffa9a66aacff/users/bb3cc7a27ebe431cbd0efe26ab808c77/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:32.691598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59d47-41b0-4a78-a6cd-caab21f72b1f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.694041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:32.879376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eae78-cb57-4e71-b862-e3fa0789db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.885353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eae78-cb57-4e71-b862-e3fa0789db11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.885353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eae78-cb57-4e71-b862-e3fa0789db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.886766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eae78-cb57-4e71-b862-e3fa0789db11 admin admin] PATH_INFO: `/v3/projects/c1f2d0ecab2a4ff6a2cbcddfb491292b/users/adefdb6977664e19a541bd134d05784e/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.909767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25873-a8ce-4e8e-a2d3-4cd8df3a405f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:32.942529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732350b-0d5b-43d2-9a5d-d1064b1d6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:32.943028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732350b-0d5b-43d2-9a5d-d1064b1d6504 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.943392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732350b-0d5b-43d2-9a5d-d1064b1d6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.943588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732350b-0d5b-43d2-9a5d-d1064b1d6504 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.944541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732350b-0d5b-43d2-9a5d-d1064b1d6504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.949685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732350b-0d5b-43d2-9a5d-d1064b1d6504 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.959664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eae78-cb57-4e71-b862-e3fa0789db11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f2d0ecab2a4ff6a2cbcddfb491292b, user_id=adefdb6977664e19a541bd134d05784e, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:32.973213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eae78-cb57-4e71-b862-e3fa0789db11 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:32.989416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 877/1727] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:32.990995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553d7e5-7cbd-490a-8aaf-ebe6e056ba9c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:32.991259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553d7e5-7cbd-490a-8aaf-ebe6e056ba9c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:32.991543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553d7e5-7cbd-490a-8aaf-ebe6e056ba9c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:32.997596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 878/1728] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:09:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:32.998541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553d7e5-7cbd-490a-8aaf-ebe6e056ba9c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:33.038487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 851/1729] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:32 2022] PUT /identity/v3/projects/c1f2d0ecab2a4ff6a2cbcddfb491292b/users/adefdb6977664e19a541bd134d05784e/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:33.058637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.059186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.059632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.086638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553d7e5-7cbd-490a-8aaf-ebe6e056ba9c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:33.146639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] MFA Rules not processed for user `adefdb6977664e19a541bd134d05784e`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:33.148358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:33.304830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e70337-a206-401d-96c4-5bc466618cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:33.306132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70337-a206-401d-96c4-5bc466618cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.306577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70337-a206-401d-96c4-5bc466618cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.307001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70337-a206-401d-96c4-5bc466618cd1 admin admin] PATH_INFO: `/v3/projects/9d1fc4ad017d48b6b471ffa9a66aacff/users/bb3cc7a27ebe431cbd0efe26ab808c77/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.315629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70337-a206-401d-96c4-5bc466618cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1fc4ad017d48b6b471ffa9a66aacff, user_id=bb3cc7a27ebe431cbd0efe26ab808c77, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:33.318649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70337-a206-401d-96c4-5bc466618cd1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:33.349390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 879/1730] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:32 2022] PUT /identity/v3/projects/9d1fc4ad017d48b6b471ffa9a66aacff/users/bb3cc7a27ebe431cbd0efe26ab808c77/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:33.351088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.354228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.354660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.397852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 852/1731] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:33.400797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:33.409436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:33.410733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:33.427401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb050d-e60d-49cb-b2c1-aa48246410f7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:33.598688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:33.599600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.599893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.600168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.601056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:33.607950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:33.612333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 880/1732] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:33.657829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:33.660690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:33.663110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 853/1733] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:33 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:33.667372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:33.694803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac1f4-9d0e-49e1-b5f4-ab2ea6c1d27e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:33.772072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:33.772906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.773300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.773714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.789423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:33.791234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:33.808867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee046e-8dc3-4c74-9c5f-5f3628324553 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:33.818131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:33.819143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.819143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.820022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.820826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:33.840525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:33.863398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 881/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:33.897667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 854/1735] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:33 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:33.901675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:33.917376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec119f-3177-4ec9-96f8-a7b0bae4aba5 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:33.928082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:33.930144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:33.931211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:33.932970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:33.933938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:33.936514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:33.963772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 882/1736] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:33.968492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:33.983110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0e1b-478d-4555-b5fe-943708bfb446 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:33.999895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:34.001160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.003328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.003789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] PATH_INFO: `/v3/projects/cebffd8be1044dd28748f32111898908/users/9061695887d345d79b0c968e8bec9bd8/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.045627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebffd8be1044dd28748f32111898908, user_id=9061695887d345d79b0c968e8bec9bd8, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:34.048599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:34.080306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:34.080489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 855/1737] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:33 2022] PUT /identity/v3/projects/cebffd8be1044dd28748f32111898908/users/9061695887d345d79b0c968e8bec9bd8/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:34.101630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dda085-f106-41c7-8f00-d22c5363d7e0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:34.172427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:34.175653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:34.252881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:34.255103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.255406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.255688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.257911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:34.259615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:34.310093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 883/1738] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:09:34.311050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:34.319885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00abd5a-01e6-4b35-893f-9e0252b19fc4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:34.334121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:34.335023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.335312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.335592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] PATH_INFO: `/v3/projects/28133c1cf54442b5a4e5019ba2d5811c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.341056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28133c1cf54442b5a4e5019ba2d5811c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:34.342806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc95c7-4561-4299-ad15-4aa2948037b4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:34.343114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:34.368007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d7dbc-4d60-43e9-b5d1-d3d0c7bf7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:34.368926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d7dbc-4d60-43e9-b5d1-d3d0c7bf7d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.371313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d7dbc-4d60-43e9-b5d1-d3d0c7bf7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.371637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d7dbc-4d60-43e9-b5d1-d3d0c7bf7d70 admin admin] PATH_INFO: `/v3/projects/cebffd8be1044dd28748f32111898908/users/9061695887d345d79b0c968e8bec9bd8/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.376857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d7dbc-4d60-43e9-b5d1-d3d0c7bf7d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebffd8be1044dd28748f32111898908, user_id=9061695887d345d79b0c968e8bec9bd8, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:34.386772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d7dbc-4d60-43e9-b5d1-d3d0c7bf7d70 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:34.416084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 884/1739] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:34 2022] PUT /identity/v3/projects/cebffd8be1044dd28748f32111898908/users/9061695887d345d79b0c968e8bec9bd8/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:34.429000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.429447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.430326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.466812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28133c1cf54442b5a4e5019ba2d5811c', 'request_id': 'req-a647e065-21dc-43ab-8580-56e5625d8303'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.480071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28133c1cf54442b5a4e5019ba2d5811c', 'request_id': 'req-a647e065-21dc-43ab-8580-56e5625d8303'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.491092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28133c1cf54442b5a4e5019ba2d5811c', 'request_id': 'req-a647e065-21dc-43ab-8580-56e5625d8303'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.498057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] MFA Rules not processed for user `9061695887d345d79b0c968e8bec9bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:34.499722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:34.515697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] The token cache is being invalidate because project 28133c1cf54442b5a4e5019ba2d5811c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:34.515988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.518890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.522453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 856/1740] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:34 2022] DELETE /identity/v3/projects/28133c1cf54442b5a4e5019ba2d5811c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:34.527272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:34.531454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:34.686185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 885/1741] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:34.698366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:34.701031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:34.729394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647e065-21dc-43ab-8580-56e5625d8303 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:34.750646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:34.751570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.751855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.752132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] PATH_INFO: `/v3/users/3e1c4974296745e99b76145e5cade1d2` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.754446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1c4974296745e99b76145e5cade1d2)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:34.756452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:34.844575 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1c4974296745e99b76145e5cade1d2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.858058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04445d-2dd9-44de-a035-3fef3eb01da0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:34.869733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c572aa-b447-4224-8023-6af54795bbf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:34.870665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c572aa-b447-4224-8023-6af54795bbf2 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:34.870925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1c4974296745e99b76145e5cade1d2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.872213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1c4974296745e99b76145e5cade1d2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.872620 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c572aa-b447-4224-8023-6af54795bbf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:34.873127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c572aa-b447-4224-8023-6af54795bbf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:34.889123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1c4974296745e99b76145e5cade1d2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.901429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1c4974296745e99b76145e5cade1d2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:34.902268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c572aa-b447-4224-8023-6af54795bbf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:34.904029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c572aa-b447-4224-8023-6af54795bbf2 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:34.912124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 857/1742] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:34 2022] DELETE /identity/v3/users/3e1c4974296745e99b76145e5cade1d2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:34.921625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 886/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:35.052371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:35.054372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:35.191806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0345bf-fb03-4a61-a097-0ff432c40092 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:35.205878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:35.207056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:35.207056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:35.207356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] PATH_INFO: `/v3/users/adefdb6977664e19a541bd134d05784e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:35.209437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adefdb6977664e19a541bd134d05784e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:35.217853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:35.379223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adefdb6977664e19a541bd134d05784e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:35.419438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adefdb6977664e19a541bd134d05784e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:35.421804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adefdb6977664e19a541bd134d05784e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:35.447715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adefdb6977664e19a541bd134d05784e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:35.483643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adefdb6977664e19a541bd134d05784e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:35.493954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 858/1744] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:35 2022] DELETE /identity/v3/users/adefdb6977664e19a541bd134d05784e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:35.498135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17d09-3468-4097-b8d1-5bf4e164d3a8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:35.498855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17d09-3468-4097-b8d1-5bf4e164d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:35.498855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17d09-3468-4097-b8d1-5bf4e164d3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:35.599857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bff17d09-3468-4097-b8d1-5bf4e164d3a8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:35.601624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bff17d09-3468-4097-b8d1-5bf4e164d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:35.737593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 887/1745] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:35.768838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:35.771173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:35.909592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f540ee-23ae-4ef8-98f2-361f074c5627 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:35.913501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:35.914346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:35.915139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:35.915139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:35.930291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:35.931699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:35.949570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 859/1746] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:36.616213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e5f0-972b-490c-831f-39a0c3487839 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:36.617633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e5f0-972b-490c-831f-39a0c3487839 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:36.618117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e5f0-972b-490c-831f-39a0c3487839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:36.652306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:36.654757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:36.676856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558afb43-53b0-496a-b5a4-bfcbe24eced2 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:36.693167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-52e5e5f0-972b-490c-831f-39a0c3487839 None None] MFA Rules not processed for user `bb3cc7a27ebe431cbd0efe26ab808c77`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:36.696259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-52e5e5f0-972b-490c-831f-39a0c3487839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:36.706926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:36.708163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:36.708559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:36.708949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] PATH_INFO: `/v3/projects/9a5da827bb0b48db9792d559e15da0ef` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:36.711488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5da827bb0b48db9792d559e15da0ef)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:36.713585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:36.871662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5da827bb0b48db9792d559e15da0ef', 'request_id': 'req-40693714-8f63-4d66-86b1-863c82aa0ac2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:36.887645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5da827bb0b48db9792d559e15da0ef', 'request_id': 'req-40693714-8f63-4d66-86b1-863c82aa0ac2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:36.900371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5da827bb0b48db9792d559e15da0ef', 'request_id': 'req-40693714-8f63-4d66-86b1-863c82aa0ac2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:36.924805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] The token cache is being invalidate because project 9a5da827bb0b48db9792d559e15da0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:36.925215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:36.926292 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-40693714-8f63-4d66-86b1-863c82aa0ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:36.941632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 860/1747] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:36 2022] DELETE /identity/v3/projects/9a5da827bb0b48db9792d559e15da0ef => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:36.944796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:36.944796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:36.946903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:36.947185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 888/1748] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:36.950315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7a88d-bdf5-478c-b9e7-9c5b708c1fc3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:36.951463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7a88d-bdf5-478c-b9e7-9c5b708c1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:36.951889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7a88d-bdf5-478c-b9e7-9c5b708c1fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:36.991147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f7c7a88d-bdf5-478c-b9e7-9c5b708c1fc3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:37.007395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7c7a88d-bdf5-478c-b9e7-9c5b708c1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:37.074404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] MFA Rules not processed for user `59ae8544d37b4de78c4164fc9de7acb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:37.079901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:37.200760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 889/1749] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:37.202859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:37.203614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:37.204163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:37.244861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:37.251173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:37.277500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 890/1750] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:37.283140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:37.298089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040270e-5566-4dff-9bea-c32178d9c636 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:37.316647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:37.317328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:37.317647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:37.317922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:37.318722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:37.329130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:37.334514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:37.373737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 891/1751] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:09:37.377944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:37.378477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 861/1752] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:37.389640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:37.395395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:37.403703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923195-5137-413a-bce9-99d6d1f253a5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:37.415637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:37.416393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:37.416691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:37.417070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:37.417909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:37.420406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:37.468886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 892/1753] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:37 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:37.470343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:37.577484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617baa36-c672-46ea-acb9-2b45e4a6fdea admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:37.592910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:37.596746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:37.596915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:37.597143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:37.599971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:37.609058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:37.672593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 893/1754] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:37 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:37.674322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:37.676892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:37.707172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23af4b0-9a13-43f6-82d6-59243b577fe2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:37.722440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835c1d-0e28-4b2c-8fc3-80e23b7062e1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:37.770539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:37.774783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:37.775225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:37.775766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] PATH_INFO: `/v3/projects/c1f2d0ecab2a4ff6a2cbcddfb491292b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:37.785173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f2d0ecab2a4ff6a2cbcddfb491292b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:37.789444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:37.833582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:37.834266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:37.834746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:37.835034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:37.997661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:38.001497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:38.022349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f2d0ecab2a4ff6a2cbcddfb491292b', 'request_id': 'req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.024871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 862/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:38.025865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:38.052148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd05e3-6eb0-4c2b-aab5-0f7d43726336 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:38.085748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f2d0ecab2a4ff6a2cbcddfb491292b', 'request_id': 'req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.127678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f2d0ecab2a4ff6a2cbcddfb491292b', 'request_id': 'req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.166896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] The token cache is being invalidate because project c1f2d0ecab2a4ff6a2cbcddfb491292b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:38.171937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.172906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.176970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 894/1756] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:37 2022] DELETE /identity/v3/projects/c1f2d0ecab2a4ff6a2cbcddfb491292b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:38.184648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:38.188935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:38.281492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:38.282612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:38.286324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:38.286698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:38.290026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:38.294620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:38.342327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 863/1757] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:38.346806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:38.354797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:38.430290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04af6-eff6-41c0-a606-515dbba7c424 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:38.456306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:38.459616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:38.459921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:38.460207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:38.461486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:38.463000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:38.513135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 864/1758] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:38.518568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:38.527257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf9ff-96d1-4023-af0b-d43113dcf5db admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:38.551380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea51b07-ecb4-4636-81c1-95559750864a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:38.554831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:38.568815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:38.570849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:38.571231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] PATH_INFO: `/v3/users/9061695887d345d79b0c968e8bec9bd8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:38.579330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036eaae-284a-4d90-9a5c-fbb7ae44adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:38.581796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9061695887d345d79b0c968e8bec9bd8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:38.583580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eaae-284a-4d90-9a5c-fbb7ae44adcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:38.584048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eaae-284a-4d90-9a5c-fbb7ae44adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:38.585963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eaae-284a-4d90-9a5c-fbb7ae44adcd admin admin] PATH_INFO: `/v3/projects/242ee4b6ad0140369f64b5ebdab63d02/users/54d3ec960e414005b74263431e9e266a/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:38.591055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:38.620309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eaae-284a-4d90-9a5c-fbb7ae44adcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=242ee4b6ad0140369f64b5ebdab63d02, user_id=54d3ec960e414005b74263431e9e266a, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:38.631509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eaae-284a-4d90-9a5c-fbb7ae44adcd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:38.674609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 865/1759] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:38 2022] PUT /identity/v3/projects/242ee4b6ad0140369f64b5ebdab63d02/users/54d3ec960e414005b74263431e9e266a/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:38.685592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:38.685941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:38.686287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:38.758267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9061695887d345d79b0c968e8bec9bd8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.789037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] MFA Rules not processed for user `54d3ec960e414005b74263431e9e266a`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:38.791360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:38.802509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9061695887d345d79b0c968e8bec9bd8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.830412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9061695887d345d79b0c968e8bec9bd8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.830412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9061695887d345d79b0c968e8bec9bd8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.852585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9061695887d345d79b0c968e8bec9bd8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:38.879178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 895/1760] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:38 2022] DELETE /identity/v3/users/9061695887d345d79b0c968e8bec9bd8 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:38.960989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 866/1761] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:38.966247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:38.967685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:39.145247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cbd86-daa2-4d51-bb00-c0c727b9b754 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:39.165850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:39.166559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:39.166840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:39.171075 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:39.171813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:39.174295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:39.266905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:39.271138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 896/1762] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:38 2022] POST /identity/v3/projects => generated 365 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:39.649782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398df85-c078-43a2-b7af-362c33f35918 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:39.984163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:39.984874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:39.985159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:39.985439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:39.986189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:39.988149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:40.052597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 867/1763] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:39 2022] POST /identity/v3/users => generated 289 bytes in 786 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:40.054168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:40.065437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987be83-a7c8-4fba-83ee-ab5c429c27af admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:40.114296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:40.115824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:40.116126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:40.116415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:40.117218 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:40.127175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:40.153110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:40.156618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 897/1764] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:40.171957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c4c3-8753-4174-b63f-111902623de8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:40.186219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:40.187472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:40.187990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:40.188470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] PATH_INFO: `/v3/projects/06adacb933f14663bae55961317d1bc4/users/5588296b9ca7454382d68ed03c7be39c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:40.255732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06adacb933f14663bae55961317d1bc4, user_id=5588296b9ca7454382d68ed03c7be39c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:40.258847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:40.281715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 868/1765] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:40 2022] PUT /identity/v3/projects/06adacb933f14663bae55961317d1bc4/users/5588296b9ca7454382d68ed03c7be39c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:40.285974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:40.297280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2fbfa-3263-48bb-a9f2-807053490d8d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:40.487161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125acd97-e323-4bdb-acdc-ea8f9e3f561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:40.488198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125acd97-e323-4bdb-acdc-ea8f9e3f561e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:40.489024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125acd97-e323-4bdb-acdc-ea8f9e3f561e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:40.489744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125acd97-e323-4bdb-acdc-ea8f9e3f561e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:40.490993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125acd97-e323-4bdb-acdc-ea8f9e3f561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:40.493251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125acd97-e323-4bdb-acdc-ea8f9e3f561e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:40.515114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 898/1766] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:09:40.519377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:40.544433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311080-ffa7-46f9-ab4d-bd8e14b0b7a3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:40.559350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:40.563308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:40.564425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:40.565332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] PATH_INFO: `/v3/projects/06adacb933f14663bae55961317d1bc4/users/5588296b9ca7454382d68ed03c7be39c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:40.571912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06adacb933f14663bae55961317d1bc4, user_id=5588296b9ca7454382d68ed03c7be39c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:40.576114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:40.609507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 869/1767] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:40 2022] PUT /identity/v3/projects/06adacb933f14663bae55961317d1bc4/users/5588296b9ca7454382d68ed03c7be39c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:40.620386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:40.620674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:40.620961 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:40.708713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] MFA Rules not processed for user `5588296b9ca7454382d68ed03c7be39c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:40.712801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:40.939201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 899/1768] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:40.953367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:40.956192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:41.155466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe1455-7414-4f30-b255-1f28e2be9c89 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:41.172152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:41.175775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:41.179920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:41.181738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:41.224134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:41.228334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:41.283210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 870/1769] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:41.480479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:41.500997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7393-324f-4042-aeff-eaa0f770061b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:41.520884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836168e-36f3-4fb2-b1bc-6522d89ee754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:41.522052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836168e-36f3-4fb2-b1bc-6522d89ee754 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:41.522615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836168e-36f3-4fb2-b1bc-6522d89ee754 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:41.523690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836168e-36f3-4fb2-b1bc-6522d89ee754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:41.681119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836168e-36f3-4fb2-b1bc-6522d89ee754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:41.682804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836168e-36f3-4fb2-b1bc-6522d89ee754 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:41.709315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 900/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:41.941627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:41.941856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:42.214880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e52af-9fbd-4ce8-af4d-d97abf053c00 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:42.222211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:42.223324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:42.223765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:42.224206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] PATH_INFO: `/v3/projects/cebffd8be1044dd28748f32111898908` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:42.225646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebffd8be1044dd28748f32111898908)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:42.227750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:42.390729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebffd8be1044dd28748f32111898908', 'request_id': 'req-3b9a6a3c-8eed-401e-83d3-0201014c3096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:42.417074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebffd8be1044dd28748f32111898908', 'request_id': 'req-3b9a6a3c-8eed-401e-83d3-0201014c3096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:42.438207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebffd8be1044dd28748f32111898908', 'request_id': 'req-3b9a6a3c-8eed-401e-83d3-0201014c3096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:42.515332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] The token cache is being invalidate because project cebffd8be1044dd28748f32111898908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:42.515430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:42.524428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3b9a6a3c-8eed-401e-83d3-0201014c3096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:42.539621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 871/1771] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:41 2022] DELETE /identity/v3/projects/cebffd8be1044dd28748f32111898908 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:42.546037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:42.546880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:42.547304 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:42.600474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:42.602904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:42.754827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 901/1772] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:42.763751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:42.764271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:42.764704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:42.795306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:42.798745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:42.833630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 872/1773] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:42.838099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:42.859872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3144-2910-4954-a0d8-18c4289060db None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:42.887286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:42.888193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:42.888647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:42.889064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:42.889995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:42.890449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:42.892237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:42.924578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 902/1774] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:42.930382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:42.985358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2a5af-79ce-4681-ab80-eca0eedb5c7e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:42.994160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:42.994896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:42.995225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:42.995560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:42.997018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:42.999566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.047801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 873/1775] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:42 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:43.052818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.066299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab9694-ffd2-463c-9405-31360c45475e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:43.227768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:43.228751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.228871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.229525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.250675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:43.260498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.300700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 903/1776] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:43 2022] POST /identity/v3/users => generated 304 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:43.305821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.322245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58ecd8-7d15-4bf3-88a7-8185d6b0a7f6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:43.335498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:43.338866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.339576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.339670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.340784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:43.345818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.369610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 874/1777] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:43.372328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.384736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58bee-c9dc-4982-b80b-6bbcae8cb0ac admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:43.393486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77a2e4-9b50-478d-931e-6b5e70c5c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:43.393486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77a2e4-9b50-478d-931e-6b5e70c5c460 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.393486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77a2e4-9b50-478d-931e-6b5e70c5c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.394351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77a2e4-9b50-478d-931e-6b5e70c5c460 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.396335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77a2e4-9b50-478d-931e-6b5e70c5c460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:43.397491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77a2e4-9b50-478d-931e-6b5e70c5c460 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.417672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 904/1778] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:43.423853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.445192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9ae35-6df9-4e6e-a1a3-b348b6bde879 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:43.455367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e56b75-4180-4995-bb01-bddd1247b633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:43.457359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56b75-4180-4995-bb01-bddd1247b633 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.457359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56b75-4180-4995-bb01-bddd1247b633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.457814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56b75-4180-4995-bb01-bddd1247b633 admin admin] PATH_INFO: `/v3/projects/cf152ea816e7490b80d981dbd0ad194a/users/eea35af47b804c1093f65dae528b73cb/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.478702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.478994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.479277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.510431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e56b75-4180-4995-bb01-bddd1247b633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf152ea816e7490b80d981dbd0ad194a, user_id=eea35af47b804c1093f65dae528b73cb, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:43.514270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e56b75-4180-4995-bb01-bddd1247b633 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.533008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] MFA Rules not processed for user `e724e0c0897b4ac1975a3ba7d1d741f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:43.535254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:43.538580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 875/1779] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:43 2022] PUT /identity/v3/projects/cf152ea816e7490b80d981dbd0ad194a/users/eea35af47b804c1093f65dae528b73cb/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:43.549352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.549989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.550307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.609181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] MFA Rules not processed for user `eea35af47b804c1093f65dae528b73cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:43.613924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:43.734416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 905/1780] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:43.747524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.749047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:43.751954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 876/1781] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:43.756682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.894651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492e72-fabd-4a78-9842-c68a8416ea53 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:43.898235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60055-4c82-460e-b168-8908e56de3cd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:43.904988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:43.905323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:43.905706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.905996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.906244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:43.906350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.906579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:43.906861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:43.907018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:43.910593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.927653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:43.934185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:43.960937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 877/1782] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:43 2022] POST /identity/v3/projects => generated 409 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:43.962546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:43.962845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 906/1783] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:43.965752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:43.974652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:44.018864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f9b22-deb4-4157-b1c4-abecf609f30e service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:44.084204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc367c2d-cef9-4fc0-b044-5b9e6c20d5fe admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:44.117531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:44.118490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.118770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.119041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] PATH_INFO: `/v3/users/fd16286a572242c99b780b205045c2fb` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.129887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd16286a572242c99b780b205045c2fb)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:44.129887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:44.214290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:44.215019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.215300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.215578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.216274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:44.229635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:44.301344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 907/1784] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:43 2022] POST /identity/v3/users => generated 311 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:44.305247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:44.314875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd16286a572242c99b780b205045c2fb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:44.340014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5cf7-e12d-4913-aae3-893d225532e3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:44.347945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd16286a572242c99b780b205045c2fb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:44.349128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd16286a572242c99b780b205045c2fb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:44.360084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:44.360769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.361046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.361317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.362080 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:44.363693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:44.370223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd16286a572242c99b780b205045c2fb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:44.387065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd16286a572242c99b780b205045c2fb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:44.399668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 908/1785] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:44.402285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:44.409884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:44.413426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 878/1786] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:43 2022] DELETE /identity/v3/users/fd16286a572242c99b780b205045c2fb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:44.451186 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0f64-eb8f-479a-8a34-724a56e1261a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:44.609078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:44.610191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.611370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.611370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] PATH_INFO: `/v3/projects/2e2175db13cd4b7eb5d346733eb2a502/users/4bb7ae4c22d44e558ad9e5f209458073/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.643141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2175db13cd4b7eb5d346733eb2a502, user_id=4bb7ae4c22d44e558ad9e5f209458073, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:44.645928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:44.663341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 909/1787] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:44 2022] PUT /identity/v3/projects/2e2175db13cd4b7eb5d346733eb2a502/users/4bb7ae4c22d44e558ad9e5f209458073/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:44.666751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:44.678578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23fbcf-4c6f-4a3f-85f2-fa5620174fbd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:44.805880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bda9c-a335-4030-91de-862972f440f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:44.811336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bda9c-a335-4030-91de-862972f440f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.811688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bda9c-a335-4030-91de-862972f440f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.811966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bda9c-a335-4030-91de-862972f440f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.813919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bda9c-a335-4030-91de-862972f440f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:44.817437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bda9c-a335-4030-91de-862972f440f5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:44.843686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 879/1788] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:44.848834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:44.864338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffff829-9a5d-43fb-be58-61eaa023c6d1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:44.879111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:44.880036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.880322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.880600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] PATH_INFO: `/v3/projects/2e2175db13cd4b7eb5d346733eb2a502/users/4bb7ae4c22d44e558ad9e5f209458073/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.886525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2175db13cd4b7eb5d346733eb2a502, user_id=4bb7ae4c22d44e558ad9e5f209458073, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:44.889282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:44.927369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 910/1789] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:44 2022] PUT /identity/v3/projects/2e2175db13cd4b7eb5d346733eb2a502/users/4bb7ae4c22d44e558ad9e5f209458073/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:44.930807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:44.931705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:44.932283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:44.977636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] MFA Rules not processed for user `4bb7ae4c22d44e558ad9e5f209458073`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:44.979337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:45.174003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 880/1790] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:45.185132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:45.190124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:45.315537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670af1-856c-4629-aa76-62da080cc395 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:45.340829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:45.341520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:45.341879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:45.342166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:45.366515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:45.368000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:45.396181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 911/1791] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:45.908190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:45.931758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0c022-fe39-4623-887d-bb6401a866cf None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:45.945165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:45.946148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:45.946576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:45.946992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:45.948954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:45.983731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:45.985728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:46.166687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:46.168882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:46.180858 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cebca-fe5f-4282-9b4d-fafab823a547 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:46.192731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 881/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:46.207359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:46.210982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:46.211340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:46.211694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] PATH_INFO: `/v3/projects/1f0feef57b7644cc9c2f67de4c551c75` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:46.215835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0feef57b7644cc9c2f67de4c551c75)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:46.221798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:46.349388 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0feef57b7644cc9c2f67de4c551c75', 'request_id': 'req-2e850574-7204-4063-8294-e2f0d07bcae5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.369508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0feef57b7644cc9c2f67de4c551c75', 'request_id': 'req-2e850574-7204-4063-8294-e2f0d07bcae5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.415392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0feef57b7644cc9c2f67de4c551c75', 'request_id': 'req-2e850574-7204-4063-8294-e2f0d07bcae5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.449335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] The token cache is being invalidate because project 1f0feef57b7644cc9c2f67de4c551c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:46.449724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.450241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2e850574-7204-4063-8294-e2f0d07bcae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.454438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 912/1793] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:45 2022] DELETE /identity/v3/projects/1f0feef57b7644cc9c2f67de4c551c75 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:46.458455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:46.473598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7843a91-3927-4f28-b6b6-7fe3ea62e245 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:46.626253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:46.627368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:46.627741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:46.628125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] PATH_INFO: `/v3/users/bb3cc7a27ebe431cbd0efe26ab808c77` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:46.629475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3cc7a27ebe431cbd0efe26ab808c77)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:46.631665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:46.730278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3cc7a27ebe431cbd0efe26ab808c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.744650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3cc7a27ebe431cbd0efe26ab808c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.745865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3cc7a27ebe431cbd0efe26ab808c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.753244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3cc7a27ebe431cbd0efe26ab808c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.762947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-32f53d5a-266f-4962-b8c4-d554746b6c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3cc7a27ebe431cbd0efe26ab808c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:46.773145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 882/1794] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:46 2022] DELETE /identity/v3/users/bb3cc7a27ebe431cbd0efe26ab808c77 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:46.937732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c676-cdb1-40f5-9d92-09fbd444a1f8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:46.938071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c676-cdb1-40f5-9d92-09fbd444a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:46.938376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c676-cdb1-40f5-9d92-09fbd444a1f8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:46.940888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 913/1795] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:09:47.015651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52130da7-bb4d-4c6d-ab5c-8b1ca1aa821f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:47.016722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52130da7-bb4d-4c6d-ab5c-8b1ca1aa821f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:47.017322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52130da7-bb4d-4c6d-ab5c-8b1ca1aa821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:47.066910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-52130da7-bb4d-4c6d-ab5c-8b1ca1aa821f None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:47.068405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-52130da7-bb4d-4c6d-ab5c-8b1ca1aa821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:47.188593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 883/1796] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:09:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:47.221368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c676-cdb1-40f5-9d92-09fbd444a1f8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:47.223140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-46c0c676-cdb1-40f5-9d92-09fbd444a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:47.244865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c676-cdb1-40f5-9d92-09fbd444a1f8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:47.256293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:47.258246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:47.258538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:47.258819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:47.282496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:47.284384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:47.310907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 914/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:48.040871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ee98-f4f4-4081-9255-604443d434b2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:48.041864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ee98-f4f4-4081-9255-604443d434b2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:48.042343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ee98-f4f4-4081-9255-604443d434b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:48.075388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bd91ee98-f4f4-4081-9255-604443d434b2 None None] MFA Rules not processed for user `59ae8544d37b4de78c4164fc9de7acb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:48.080064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:48.080960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:48.090683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bd91ee98-f4f4-4081-9255-604443d434b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:48.335481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31bb96-f4b9-4ef8-a8bb-6c7d1d68fa13 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:48.336428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 884/1798] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:48.342154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:48.343275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:48.343852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:48.344299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] PATH_INFO: `/v3/projects/9d1fc4ad017d48b6b471ffa9a66aacff` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:48.346092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1fc4ad017d48b6b471ffa9a66aacff)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:48.348221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:48.426376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1fc4ad017d48b6b471ffa9a66aacff', 'request_id': 'req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:48.437986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1fc4ad017d48b6b471ffa9a66aacff', 'request_id': 'req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:48.468930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1fc4ad017d48b6b471ffa9a66aacff', 'request_id': 'req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:48.494172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] The token cache is being invalidate because project 9d1fc4ad017d48b6b471ffa9a66aacff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:48.495306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:48.496451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf54002d-d1d3-4f04-bbb7-98873bf4e5cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:48.503905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 915/1799] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:48 2022] DELETE /identity/v3/projects/9d1fc4ad017d48b6b471ffa9a66aacff => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:48.505045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:48.505397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:48.505759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:48.557869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:48.559557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:48.732462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 885/1800] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:48.740839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:48.742113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:48.742663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:48.790114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:48.792314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:48.815398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 916/1801] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:48.819759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:48.831244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b29aaa-8cc3-4500-8f49-e1055926f03e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:48.864319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:48.865018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:48.865303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:48.865596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:48.866343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:48.866646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:48.868253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:48.905357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 886/1802] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:48.911223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:48.926854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fcc1a-15a5-461f-b877-a39fe65a10c1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:48.932201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:48.933084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:48.933511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:48.933921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:48.934870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:48.937202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:48.982167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 917/1803] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:48 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:48.985585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.006545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983c7c-9c88-4247-b704-1fbd9de5afd3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:49.153103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:49.155490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.155952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.157000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.158023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:49.162214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:49.192929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 887/1804] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:48 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:49.194176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.212634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339c9b1-e098-4a43-a08c-4daa4fd6bcfb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:49.228201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:49.228898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.229356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.229712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.230517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:49.234653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:49.251946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 918/1805] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:09:49.254226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.269235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644c685-e577-428b-af8f-c553b4b3c6e2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:49.288659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:49.294883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.295154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.295436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.296251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:49.299483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:49.331422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 888/1806] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:49.335674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.350606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b931-3853-42c5-b56a-fbd2d45c1234 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:49.360954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.364825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114663f5-8b83-40c9-b582-4f7a2405c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:49.367041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114663f5-8b83-40c9-b582-4f7a2405c3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.367784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114663f5-8b83-40c9-b582-4f7a2405c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.368923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:49.369355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114663f5-8b83-40c9-b582-4f7a2405c3f1 admin admin] PATH_INFO: `/v3/projects/56828777053a42e89c7aac1cf7b87483/users/e78b6419ef104f26bfe61694d1a36457/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.400661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114663f5-8b83-40c9-b582-4f7a2405c3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56828777053a42e89c7aac1cf7b87483, user_id=e78b6419ef104f26bfe61694d1a36457, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:49.405446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4f0c5-7cc9-472e-a620-fbc6a30674fd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:49.407881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114663f5-8b83-40c9-b582-4f7a2405c3f1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:49.419007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:49.421256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.421937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.422815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] PATH_INFO: `/v3/users/54d3ec960e414005b74263431e9e266a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.425531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d3ec960e414005b74263431e9e266a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:49.427711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:49.435561 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 919/1807] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:49 2022] PUT /identity/v3/projects/56828777053a42e89c7aac1cf7b87483/users/e78b6419ef104f26bfe61694d1a36457/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:49.446316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.448019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.452147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.496725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d3ec960e414005b74263431e9e266a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:49.534396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] MFA Rules not processed for user `e78b6419ef104f26bfe61694d1a36457`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:49.538282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d3ec960e414005b74263431e9e266a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:49.538917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:49.540129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d3ec960e414005b74263431e9e266a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:49.554492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d3ec960e414005b74263431e9e266a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:49.569550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4afb8d55-cda5-401b-9d80-cbaf9d86a510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d3ec960e414005b74263431e9e266a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:49.591442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 889/1808] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:49 2022] DELETE /identity/v3/users/54d3ec960e414005b74263431e9e266a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:49.598037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607609e7-70ff-41ba-b279-8db267039076 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.598334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607609e7-70ff-41ba-b279-8db267039076 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.601091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607609e7-70ff-41ba-b279-8db267039076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.659977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-607609e7-70ff-41ba-b279-8db267039076 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:49.662775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-607609e7-70ff-41ba-b279-8db267039076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:49.709709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 920/1809] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:49.711006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.716614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:49.835799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 890/1810] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:49.837208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.837503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.839620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.853503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a0c4a-abc3-4a23-b108-2833b7f8eb2e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:49.873193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:49.873840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:49.874227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:49.874431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:49.875357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:49.877544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:49.898589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] MFA Rules not processed for user `e724e0c0897b4ac1975a3ba7d1d741f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:49.899926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:49.918326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 921/1811] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:49 2022] POST /identity/v3/projects => generated 391 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:49.919167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.923547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:49.978599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 891/1812] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:49.979580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:49.992546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade59130-b986-43c1-aaa7-16c92975fb7e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.003144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46fd72-7666-4fa2-8115-b3a10ce3f87e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.007068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.007714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.007996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.008329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.083933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.084837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.085207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.085487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.086367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.088507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.108753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.110523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.114647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 892/1813] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:49 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:50.116069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.122706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 922/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:50.126980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe79940-78d5-4fec-9715-24d4ecb953ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.146139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.146846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.147133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.147415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.148151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.149791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.164223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 893/1815] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:50.166449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.179540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94123-7e4b-42eb-a8c7-abcabffa0dee service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.186311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.187670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.187670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.187971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] PATH_INFO: `/v3/projects/6f4750094a83458187c373f364199dac/users/9f53eaa21ac046a89cfa32f4efb7f92d/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.208134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4750094a83458187c373f364199dac, user_id=9f53eaa21ac046a89cfa32f4efb7f92d, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.211527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.236151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.236663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 923/1816] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:50 2022] PUT /identity/v3/projects/6f4750094a83458187c373f364199dac/users/9f53eaa21ac046a89cfa32f4efb7f92d/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:50.249411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ffe50-7f1e-4141-be66-49d9f9fa1286 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.313601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d8f83-032e-4677-9533-7358878304e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.314423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8f83-032e-4677-9533-7358878304e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.314942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8f83-032e-4677-9533-7358878304e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.315440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8f83-032e-4677-9533-7358878304e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.316391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8f83-032e-4677-9533-7358878304e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.318256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8f83-032e-4677-9533-7358878304e7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.329327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 894/1817] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:50.333602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.344668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0b67d-256b-4fe6-a3be-8221599eabe5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.350174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829014b0-1dd2-44c8-8b51-2dca4140edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.350381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94beb-62cb-43ed-902d-1552ed1f56f2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.350905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94beb-62cb-43ed-902d-1552ed1f56f2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.351260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94beb-62cb-43ed-902d-1552ed1f56f2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.352129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829014b0-1dd2-44c8-8b51-2dca4140edb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.352630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829014b0-1dd2-44c8-8b51-2dca4140edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.353092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829014b0-1dd2-44c8-8b51-2dca4140edb3 admin admin] PATH_INFO: `/v3/projects/6f4750094a83458187c373f364199dac/users/9f53eaa21ac046a89cfa32f4efb7f92d/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.354111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 895/1818] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:09:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 14:09:50.357486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829014b0-1dd2-44c8-8b51-2dca4140edb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4750094a83458187c373f364199dac, user_id=9f53eaa21ac046a89cfa32f4efb7f92d, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.360416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829014b0-1dd2-44c8-8b51-2dca4140edb3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.363090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.363373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.366305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.375863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 924/1819] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:50 2022] PUT /identity/v3/projects/6f4750094a83458187c373f364199dac/users/9f53eaa21ac046a89cfa32f4efb7f92d/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:50.385844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:50.387926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:50.388069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.388337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.388616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.418413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] MFA Rules not processed for user `9f53eaa21ac046a89cfa32f4efb7f92d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:50.419638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:50.494547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 925/1820] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:50.498878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 896/1821] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:09:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:50.507256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.508950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:50.576692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4fa1c-a0d2-4c23-a636-6f343530cff5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.582848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.583670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.584112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.584521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.596476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.598373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.609810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 926/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:50.668045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.670666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:50.685156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a991ef-333e-460d-9e48-6d3151f5d4d6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.689375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.690049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.690996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.691419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.706828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.709050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:50.737125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9952c-c6d7-45b5-b8c1-3a904ad68adc service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.742916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.743565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.743996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.744415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.757739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.759567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.773390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 927/1823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:50.780474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.782431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:50.799515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 897/1824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:50.831772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:50.833281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:50.963154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ad6-91e3-4ca5-9b4a-94eed8b500ff service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:50.969200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:50.971258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:50.971755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:50.972113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] PATH_INFO: `/v3/projects/242ee4b6ad0140369f64b5ebdab63d02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:50.973545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=242ee4b6ad0140369f64b5ebdab63d02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:50.977939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:51.045277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242ee4b6ad0140369f64b5ebdab63d02', 'request_id': 'req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.055212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242ee4b6ad0140369f64b5ebdab63d02', 'request_id': 'req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.074897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242ee4b6ad0140369f64b5ebdab63d02', 'request_id': 'req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.099536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] The token cache is being invalidate because project 242ee4b6ad0140369f64b5ebdab63d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:51.099823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.102307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.104144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 928/1825] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:50 2022] DELETE /identity/v3/projects/242ee4b6ad0140369f64b5ebdab63d02 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:51.111983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:51.146907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f417f4-cd7d-434b-95ba-46395115b462 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:51.223995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:51.225052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:51.225376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:51.225760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] PATH_INFO: `/v3/users/5588296b9ca7454382d68ed03c7be39c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:51.227053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5588296b9ca7454382d68ed03c7be39c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:51.229156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:51.325424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5588296b9ca7454382d68ed03c7be39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.336986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5588296b9ca7454382d68ed03c7be39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.337787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5588296b9ca7454382d68ed03c7be39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.345774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5588296b9ca7454382d68ed03c7be39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.353798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d6181795-f7c8-4a07-921c-6f9f4300c80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5588296b9ca7454382d68ed03c7be39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.360739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 898/1826] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:51 2022] DELETE /identity/v3/users/5588296b9ca7454382d68ed03c7be39c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:51.630980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:51.633243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:51.648815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c066db7-181d-47e2-9df9-8fd1be7bb9bd admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:51.707828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:51.708694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:51.708976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:51.709249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] PATH_INFO: `/v3/projects/06adacb933f14663bae55961317d1bc4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:51.710472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06adacb933f14663bae55961317d1bc4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:51.712372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:51.892027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06adacb933f14663bae55961317d1bc4', 'request_id': 'req-b0df2235-fec1-4d24-8dd2-46d45d9aee42'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.899736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06adacb933f14663bae55961317d1bc4', 'request_id': 'req-b0df2235-fec1-4d24-8dd2-46d45d9aee42'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.907832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06adacb933f14663bae55961317d1bc4', 'request_id': 'req-b0df2235-fec1-4d24-8dd2-46d45d9aee42'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.920982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] The token cache is being invalidate because project 06adacb933f14663bae55961317d1bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:51.921257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.921927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b0df2235-fec1-4d24-8dd2-46d45d9aee42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:51.923550 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 929/1827] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:51 2022] DELETE /identity/v3/projects/06adacb933f14663bae55961317d1bc4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:51.928473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:51.928951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:51.929301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:51.950354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:51.951859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:52.021644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 899/1828] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:52.029752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.030035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.030309 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.057026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:52.062039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:52.091677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 930/1829] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:52.097354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.111675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246b9c-27e1-46ed-b4fd-b0fbfecf2ae9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.122854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556335-e265-47d6-b593-29290981507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.123769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556335-e265-47d6-b593-29290981507c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.126022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556335-e265-47d6-b593-29290981507c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.126315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556335-e265-47d6-b593-29290981507c admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.127120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556335-e265-47d6-b593-29290981507c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:52.127432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556335-e265-47d6-b593-29290981507c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.129434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556335-e265-47d6-b593-29290981507c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.143587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 900/1830] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:52.148412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.160991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d9950-ea34-4741-b5d0-800d48fe40f7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.174647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.175867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.176633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.176970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.178071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.182347 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.250404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 931/1831] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:52 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:52.252123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556335-e265-47d6-b593-29290981507c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.266615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556335-e265-47d6-b593-29290981507c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.451445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.452213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.452850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.453137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.454204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.456265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.503447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 901/1832] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:52 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:52.507392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.525832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52676bb6-d027-4bfa-bc8b-713c29fd0585 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.534081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.534771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.535055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.541702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.543761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.547757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.571837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 932/1833] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:52.573118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.584178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c25e4-8a8a-48b1-a3e9-c062e5cf8f33 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.590384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b7f6-20ed-45f0-ac16-840f5fb42d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.591061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b7f6-20ed-45f0-ac16-840f5fb42d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.591340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b7f6-20ed-45f0-ac16-840f5fb42d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.591613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b7f6-20ed-45f0-ac16-840f5fb42d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.592337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81b7f6-20ed-45f0-ac16-840f5fb42d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.594399 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81b7f6-20ed-45f0-ac16-840f5fb42d4c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.606608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 902/1834] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:52.610716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.626658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307c52a-9055-46ee-9f38-a101b61e54f3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.639557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.640576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.641094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.641584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] PATH_INFO: `/v3/projects/9649251c6d7b48ddb2d4f4f777824cdf/users/a57f789443a843779d96dae29457bc7f/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.664695 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9649251c6d7b48ddb2d4f4f777824cdf, user_id=a57f789443a843779d96dae29457bc7f, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.666339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.686331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 933/1835] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:52 2022] PUT /identity/v3/projects/9649251c6d7b48ddb2d4f4f777824cdf/users/a57f789443a843779d96dae29457bc7f/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:52.697255 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.697722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.698160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.726603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] MFA Rules not processed for user `a57f789443a843779d96dae29457bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:52.727905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:52.810900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 903/1836] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:52.814868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.896464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00db3-0bb0-4d1f-8e59-64b736fb735f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:52.902538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:52.903313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:52.903596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:52.903942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:52.904568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:52.906612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:52.938369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 934/1837] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:52 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:52.942733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:52.957822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3af4d-a636-4817-ac0b-1ec259aedb92 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:53.042009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:53.043681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.044147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.044559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.045727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:53.049493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:53.083566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 904/1838] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:52 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:53.087848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:53.122658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ed7a3-188b-45a8-824f-af076071d495 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:53.156802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:53.158066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.158505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.159212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.165237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:53.171664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:53.210836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:53.211763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 935/1839] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:53.236637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc98ea-a304-4339-8726-dcdd99a817a4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:53.247747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:53.249430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.249936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.250353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] PATH_INFO: `/v3/projects/c964f153d5334ab59496a867dc95a751/users/7a505b8a0f6c4d47acaeeb0615134cef/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.279460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c964f153d5334ab59496a867dc95a751, user_id=7a505b8a0f6c4d47acaeeb0615134cef, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:53.282898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:53.305364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 905/1840] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:53 2022] PUT /identity/v3/projects/c964f153d5334ab59496a867dc95a751/users/7a505b8a0f6c4d47acaeeb0615134cef/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:53.306628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:53.321403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03ed1-743d-4cd7-9adb-a2e86548822e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:53.417231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ef5f5-14b4-4fa0-914a-e101c3eabec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:53.418572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ef5f5-14b4-4fa0-914a-e101c3eabec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.418997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ef5f5-14b4-4fa0-914a-e101c3eabec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.419305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ef5f5-14b4-4fa0-914a-e101c3eabec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.420122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ef5f5-14b4-4fa0-914a-e101c3eabec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:53.421818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ef5f5-14b4-4fa0-914a-e101c3eabec9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:53.442756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 936/1841] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:53.447184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:53.458669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0a0ec-8c1b-4da5-86bd-a0606e332b3a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:53.463290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:53.465790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.465790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.465790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] PATH_INFO: `/v3/projects/c964f153d5334ab59496a867dc95a751/users/7a505b8a0f6c4d47acaeeb0615134cef/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.467276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c964f153d5334ab59496a867dc95a751, user_id=7a505b8a0f6c4d47acaeeb0615134cef, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:53.470205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:53.481101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 906/1842] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:53 2022] PUT /identity/v3/projects/c964f153d5334ab59496a867dc95a751/users/7a505b8a0f6c4d47acaeeb0615134cef/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:53.492545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.492829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.493102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.543628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] MFA Rules not processed for user `7a505b8a0f6c4d47acaeeb0615134cef`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:53.545997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:53.727025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 937/1843] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:53.737483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:53.739766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:53.807461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126d3e-0873-44f7-95db-b3f9ec24933c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:53.811561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff042eca-a727-4243-8bcc-a60707723f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:53.812317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff042eca-a727-4243-8bcc-a60707723f57 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:53.812665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff042eca-a727-4243-8bcc-a60707723f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:53.813007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff042eca-a727-4243-8bcc-a60707723f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:53.822863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff042eca-a727-4243-8bcc-a60707723f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:53.824980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff042eca-a727-4243-8bcc-a60707723f57 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:53.834796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 907/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:54.226252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:54.294092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b1880-4034-4c5e-9071-58e6155a1e90 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:54.298601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:54.299478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:54.299761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:54.300035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] PATH_INFO: `/v3/users/a57f789443a843779d96dae29457bc7f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:54.301232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57f789443a843779d96dae29457bc7f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:54.303194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:54.349812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57f789443a843779d96dae29457bc7f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:54.360953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57f789443a843779d96dae29457bc7f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:54.368929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57f789443a843779d96dae29457bc7f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:54.369549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57f789443a843779d96dae29457bc7f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:54.376828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57f789443a843779d96dae29457bc7f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:54.384611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 938/1845] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:54 2022] DELETE /identity/v3/users/a57f789443a843779d96dae29457bc7f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:54.389765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:54.390251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:54.390342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:54.455303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:54.456530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:54.553088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 908/1846] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:54.563431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:54.565058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:54.659961 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549039b6-fa65-4ef7-a9f6-9d2957f17901 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:54.663797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:54.664445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:54.664728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:54.665005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:54.674682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:54.676099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:54.686121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 939/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:09:54.945650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:54.947143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:54.958990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7623a9-292f-4ca2-9bbe-2661be90d9d8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:54.963791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:54.964692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:54.965109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:54.965395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] PATH_INFO: `/v3/projects/9649251c6d7b48ddb2d4f4f777824cdf` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:54.966619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9649251c6d7b48ddb2d4f4f777824cdf)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:54.968524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.016186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9649251c6d7b48ddb2d4f4f777824cdf', 'request_id': 'req-631da8de-9b2f-41e6-afe1-1f63e30d703e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.023773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9649251c6d7b48ddb2d4f4f777824cdf', 'request_id': 'req-631da8de-9b2f-41e6-afe1-1f63e30d703e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.030149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9649251c6d7b48ddb2d4f4f777824cdf', 'request_id': 'req-631da8de-9b2f-41e6-afe1-1f63e30d703e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.040916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] The token cache is being invalidate because project 9649251c6d7b48ddb2d4f4f777824cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:55.041200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.041919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.044702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 909/1848] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:54 2022] DELETE /identity/v3/projects/9649251c6d7b48ddb2d4f4f777824cdf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:55.048715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:55.058717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567661e4-2c2e-44e4-a560-05134a432eea service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:55.121357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:55.122266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.122543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.122836 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] PATH_INFO: `/v3/users/7a505b8a0f6c4d47acaeeb0615134cef` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.124004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a505b8a0f6c4d47acaeeb0615134cef)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:55.125949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.168214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a505b8a0f6c4d47acaeeb0615134cef'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.179059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a505b8a0f6c4d47acaeeb0615134cef'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.186281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a505b8a0f6c4d47acaeeb0615134cef'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.186879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a505b8a0f6c4d47acaeeb0615134cef'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.193993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2565ed20-b50f-46a2-8c34-6018af4ec953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a505b8a0f6c4d47acaeeb0615134cef'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.200147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 940/1849] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:55 2022] DELETE /identity/v3/users/7a505b8a0f6c4d47acaeeb0615134cef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:55.469527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:55.471075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:55.502157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631da8de-9b2f-41e6-afe1-1f63e30d703e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:55.563594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:55.564464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.564746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.565020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] PATH_INFO: `/v3/projects/c964f153d5334ab59496a867dc95a751` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.566205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c964f153d5334ab59496a867dc95a751)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:55.568137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.617074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c964f153d5334ab59496a867dc95a751', 'request_id': 'req-6394c00a-5d2d-41ce-b55d-07e58bf4080a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.624885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c964f153d5334ab59496a867dc95a751', 'request_id': 'req-6394c00a-5d2d-41ce-b55d-07e58bf4080a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.631278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c964f153d5334ab59496a867dc95a751', 'request_id': 'req-6394c00a-5d2d-41ce-b55d-07e58bf4080a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.642145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] The token cache is being invalidate because project c964f153d5334ab59496a867dc95a751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:55.642430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.643070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6394c00a-5d2d-41ce-b55d-07e58bf4080a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:55.644613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 910/1850] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:55 2022] DELETE /identity/v3/projects/c964f153d5334ab59496a867dc95a751 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:55.649394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.649736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.650015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.686667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:55.687871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:55.747933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 941/1851] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:55.756033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.756321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.756598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.774187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:55.775367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:55.783148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 911/1852] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:55.787636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:55.797444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb228-5ea4-4448-89f8-c3f4080d348c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:55.801864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:55.802497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.802775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.803044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.803756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:55.804052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:55.805642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.817082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 942/1853] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:55.821052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:55.830113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655d171-249d-4233-8a2c-6b25095aedc3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:55.834736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:55.835378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.835660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.835933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.836621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:55.838565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.865992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 912/1854] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:55 2022] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:55.867044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:55.877723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458b6b-acaf-48f8-af59-1972e907441f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:55.931089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:55.931756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.932036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.932308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.933656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:55.935586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.954264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 943/1855] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:55 2022] POST /identity/v3/users => generated 281 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:55.958666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:55.968711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4ec47-a2c3-4f9d-ab5d-6f640929c9c5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:55.973248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:55.973929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:55.974211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:55.974484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:55.975225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:55.976802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:55.987245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 913/1856] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:55.991023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:56.001173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d1ba-c66b-404e-8c47-02b441e3d313 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:56.005714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80238594-210d-4698-9b7c-5aca326b8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:56.006357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238594-210d-4698-9b7c-5aca326b8738 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.006633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238594-210d-4698-9b7c-5aca326b8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.006905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238594-210d-4698-9b7c-5aca326b8738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.007643 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80238594-210d-4698-9b7c-5aca326b8738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:56.009204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80238594-210d-4698-9b7c-5aca326b8738 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:56.019329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 944/1857] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:56.023211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:56.033302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f2d1-4288-47bb-949a-d1c804b62d65 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:56.038075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:56.038938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.039218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.039489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] PATH_INFO: `/v3/projects/70563574e64045b79d5d01fc705dd3e0/users/12effda57dff4f34bbd4cbf537ac96fe/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.053936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=70563574e64045b79d5d01fc705dd3e0, user_id=12effda57dff4f34bbd4cbf537ac96fe, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:56.056557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:56.069338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 914/1858] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:56 2022] PUT /identity/v3/projects/70563574e64045b79d5d01fc705dd3e0/users/12effda57dff4f34bbd4cbf537ac96fe/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:09:56.079545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.080004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.080087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.106596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] MFA Rules not processed for user `12effda57dff4f34bbd4cbf537ac96fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:56.107886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:56.171341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 945/1859] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:56.221813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:56.224755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:56.312589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98867a5-3ead-4957-aece-568eb3bcddbc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:56.316773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e972dc2-7720-4020-8d76-35f9ca81992c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:56.317157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972dc2-7720-4020-8d76-35f9ca81992c service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.317437 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972dc2-7720-4020-8d76-35f9ca81992c service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.317757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972dc2-7720-4020-8d76-35f9ca81992c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.331196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e972dc2-7720-4020-8d76-35f9ca81992c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:56.332811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e972dc2-7720-4020-8d76-35f9ca81992c service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:56.343021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 915/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:56.359828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:56.421472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7a863-2d21-4ed9-b009-789e2b41cdfd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:56.426973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:56.428223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.428512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.428792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] PATH_INFO: `/v3/users/12effda57dff4f34bbd4cbf537ac96fe` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.430183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12effda57dff4f34bbd4cbf537ac96fe)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:56.433256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:56.489913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12effda57dff4f34bbd4cbf537ac96fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:56.501516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12effda57dff4f34bbd4cbf537ac96fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:56.509063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12effda57dff4f34bbd4cbf537ac96fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:56.509853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12effda57dff4f34bbd4cbf537ac96fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:56.518340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12effda57dff4f34bbd4cbf537ac96fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:56.525241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 946/1861] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:09:56 2022] DELETE /identity/v3/users/12effda57dff4f34bbd4cbf537ac96fe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:56.530348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.530856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.530934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.549103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:56.550353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:56.625815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 916/1862] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:09:56.635458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:56.637337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:56.705763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e13c-1339-4adb-8f21-d97f594a611a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:56.709346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737d8c-77cd-45af-889d-137e4dfa766a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:56.710026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737d8c-77cd-45af-889d-137e4dfa766a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:56.710300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737d8c-77cd-45af-889d-137e4dfa766a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:56.710571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737d8c-77cd-45af-889d-137e4dfa766a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:56.719806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737d8c-77cd-45af-889d-137e4dfa766a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:56.721212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737d8c-77cd-45af-889d-137e4dfa766a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:56.731403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 947/1863] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:09:57.011535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.013527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:57.027976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ebcc-9130-4bc3-900b-b0edc992b51c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.033206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.034370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.034654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.034923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] PATH_INFO: `/v3/projects/70563574e64045b79d5d01fc705dd3e0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.036110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70563574e64045b79d5d01fc705dd3e0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.038078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.085377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70563574e64045b79d5d01fc705dd3e0', 'request_id': 'req-359aac1d-13f6-4961-ac55-378698b4a8e0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:57.094379 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70563574e64045b79d5d01fc705dd3e0', 'request_id': 'req-359aac1d-13f6-4961-ac55-378698b4a8e0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:57.102223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70563574e64045b79d5d01fc705dd3e0', 'request_id': 'req-359aac1d-13f6-4961-ac55-378698b4a8e0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:57.112903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] The token cache is being invalidate because project 70563574e64045b79d5d01fc705dd3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:09:57.114274 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:57.114956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-359aac1d-13f6-4961-ac55-378698b4a8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:09:57.116677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 917/1864] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:09:57 2022] DELETE /identity/v3/projects/70563574e64045b79d5d01fc705dd3e0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:57.123373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.123846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.124042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.143004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:57.144958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:57.206716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 948/1865] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:57.215128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.215421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.215701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.234043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:57.235219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:57.242940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 918/1866] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:57.247119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.256644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33ff1d-1c4b-4ceb-af51-16a1eb822f87 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.262054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.262700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.262983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.263258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.263978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:09:57.264286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.265895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.277618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 949/1867] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:09:57.281805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.291516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650852d-ebcf-456b-891b-ee0ffc03cb4e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.296232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.296890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.297169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.297443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.298204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.300101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.328507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 919/1868] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:09:57.329905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.340421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40168943-f28d-4cb5-bc40-5a26715ac9d6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.393575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.394244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.394524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.394796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.395508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.397411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.421937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 950/1869] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:09:57 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:09:57.426234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.436617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9aa75-667a-4826-adc4-cd1a8c07bf5b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.441276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.441997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.442283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.442565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.443296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.444905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.456941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 920/1870] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:57.461125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.473764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d646997-7f57-4ddc-8a89-0025d9e15af7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.482023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a747a0-e854-49c6-a3f6-f1f6a3345407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.482728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a747a0-e854-49c6-a3f6-f1f6a3345407 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.483212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a747a0-e854-49c6-a3f6-f1f6a3345407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.483311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a747a0-e854-49c6-a3f6-f1f6a3345407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.484006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a747a0-e854-49c6-a3f6-f1f6a3345407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.485637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a747a0-e854-49c6-a3f6-f1f6a3345407 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.498488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 951/1871] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:09:57.502342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.512634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38fa5c-411c-4871-9ac6-8cbd5f9d12ce admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.517195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.518105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.518388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.518659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] PATH_INFO: `/v3/projects/6135aef7c82a4e359d338c2f2aceba15/users/9b932314ea964cc39c91d4731af99b41/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.533329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6135aef7c82a4e359d338c2f2aceba15, user_id=9b932314ea964cc39c91d4731af99b41, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.536385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.549043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 921/1872] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:09:57 2022] PUT /identity/v3/projects/6135aef7c82a4e359d338c2f2aceba15/users/9b932314ea964cc39c91d4731af99b41/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:09:57.559719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.560008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.560290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.586961 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] MFA Rules not processed for user `9b932314ea964cc39c91d4731af99b41`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:09:57.588226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:57.650883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 952/1873] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:09:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:09:57.662137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:09:57.663800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:09:57.723343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d3509-832e-4bcf-ac84-63b1fa3113e1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:09:57.727179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d34d5-dd10-48b0-bd0f-df327780fc4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:09:57.727829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d34d5-dd10-48b0-bd0f-df327780fc4c service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:09:57.728121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d34d5-dd10-48b0-bd0f-df327780fc4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:09:57.728390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d34d5-dd10-48b0-bd0f-df327780fc4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:09:57.740327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d34d5-dd10-48b0-bd0f-df327780fc4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:09:57.741816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d34d5-dd10-48b0-bd0f-df327780fc4c service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:09:57.757049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 922/1874] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:09:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:00.403230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:00.404930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:00.535033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f6608-4d11-442a-bbca-2c6bc574d104 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:00.542866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:00.543034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:00.543287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:00.543725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] PATH_INFO: `/v3/users/e78b6419ef104f26bfe61694d1a36457` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:00.545336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78b6419ef104f26bfe61694d1a36457)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:00.565297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:00.637622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78b6419ef104f26bfe61694d1a36457'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:00.654465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78b6419ef104f26bfe61694d1a36457'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:00.675295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78b6419ef104f26bfe61694d1a36457'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:00.677059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78b6419ef104f26bfe61694d1a36457'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:00.694804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78b6419ef104f26bfe61694d1a36457'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:00.712519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 953/1875] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:00 2022] DELETE /identity/v3/users/e78b6419ef104f26bfe61694d1a36457 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:00.717700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:00.719217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:00.719684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:00.746426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:00.747879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:00.749425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:00.752059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:00.867052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 923/1876] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:00.880406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78ab1a-5798-43ed-8c60-a87f83721e4f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:00.890772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:00.892843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:00.893772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:00.894113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:00.895048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] PATH_INFO: `/v3/users/eea35af47b804c1093f65dae528b73cb` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:00.895531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:00.897191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea35af47b804c1093f65dae528b73cb)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:00.902462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:00.987374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15549-3894-4160-8e92-dec06a9fd2b6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:00.995212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea35af47b804c1093f65dae528b73cb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:00.996089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f37ea-e0f4-4707-b98f-088e732651ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:00.996900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f37ea-e0f4-4707-b98f-088e732651ef service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:00.997185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f37ea-e0f4-4707-b98f-088e732651ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:00.997459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f37ea-e0f4-4707-b98f-088e732651ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:01.008592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea35af47b804c1093f65dae528b73cb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.022369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea35af47b804c1093f65dae528b73cb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.022561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f37ea-e0f4-4707-b98f-088e732651ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:01.023077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea35af47b804c1093f65dae528b73cb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.024247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f37ea-e0f4-4707-b98f-088e732651ef service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:01.034222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea35af47b804c1093f65dae528b73cb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.043634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 924/1877] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:01.052130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 954/1878] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:00 2022] DELETE /identity/v3/users/eea35af47b804c1093f65dae528b73cb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:01.053929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:01.054318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:01.055111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:01.083516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:01.085322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:01.230138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 925/1879] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:01.400865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:01.402983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:01.485745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9746-39f4-4f2a-9124-cd56561f421b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:01.493346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:01.494044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:01.494323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:01.494598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:01.516233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:01.518675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:01.531478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 955/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:01.828745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:01.830981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:01.862751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae8d-2c89-4b8c-856a-2e705742ec1b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:01.869728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:01.871186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:01.871485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:01.871736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] PATH_INFO: `/v3/projects/56828777053a42e89c7aac1cf7b87483` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:01.873651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56828777053a42e89c7aac1cf7b87483)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:01.875580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:01.954772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56828777053a42e89c7aac1cf7b87483', 'request_id': 'req-c5686c98-1ad7-4375-8663-5a496cc07754'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.963544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56828777053a42e89c7aac1cf7b87483', 'request_id': 'req-c5686c98-1ad7-4375-8663-5a496cc07754'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.972546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56828777053a42e89c7aac1cf7b87483', 'request_id': 'req-c5686c98-1ad7-4375-8663-5a496cc07754'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.988700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] The token cache is being invalidate because project 56828777053a42e89c7aac1cf7b87483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:01.989293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.990498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:01.998283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 926/1881] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:01 2022] DELETE /identity/v3/projects/56828777053a42e89c7aac1cf7b87483 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:01.998962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.009941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440feaa8-4861-455d-92b9-be852edd62ea service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:02.085083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:02.086430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.086919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.087562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] PATH_INFO: `/v3/users/9f53eaa21ac046a89cfa32f4efb7f92d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.090132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f53eaa21ac046a89cfa32f4efb7f92d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:02.092882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:02.173381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.174840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:02.200067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686c98-1ad7-4375-8663-5a496cc07754 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:02.208113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:02.208992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.209433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.209868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] PATH_INFO: `/v3/projects/cf152ea816e7490b80d981dbd0ad194a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.215417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf152ea816e7490b80d981dbd0ad194a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:02.220976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:02.236904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f53eaa21ac046a89cfa32f4efb7f92d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.253645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f53eaa21ac046a89cfa32f4efb7f92d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.269492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f53eaa21ac046a89cfa32f4efb7f92d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.270222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f53eaa21ac046a89cfa32f4efb7f92d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.284595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f53eaa21ac046a89cfa32f4efb7f92d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.296511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 956/1882] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:01 2022] DELETE /identity/v3/users/9f53eaa21ac046a89cfa32f4efb7f92d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:02.348235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf152ea816e7490b80d981dbd0ad194a', 'request_id': 'req-2ac07852-e40c-47fb-a8f0-a952ac908b98'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.358905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf152ea816e7490b80d981dbd0ad194a', 'request_id': 'req-2ac07852-e40c-47fb-a8f0-a952ac908b98'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.366433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf152ea816e7490b80d981dbd0ad194a', 'request_id': 'req-2ac07852-e40c-47fb-a8f0-a952ac908b98'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.377659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] The token cache is being invalidate because project cf152ea816e7490b80d981dbd0ad194a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:02.377946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.378647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.380206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 927/1883] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:02 2022] DELETE /identity/v3/projects/cf152ea816e7490b80d981dbd0ad194a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:02.384321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.386049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:02.467120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e99a-76ac-489b-954b-c25927e38edc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:02.545869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:02.546764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.547041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.547314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] PATH_INFO: `/v3/users/4bb7ae4c22d44e558ad9e5f209458073` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.548560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb7ae4c22d44e558ad9e5f209458073)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:02.550535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:02.605225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb7ae4c22d44e558ad9e5f209458073'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.613879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.615452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:02.621241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb7ae4c22d44e558ad9e5f209458073'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.628639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac07852-e40c-47fb-a8f0-a952ac908b98 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:02.633428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb7ae4c22d44e558ad9e5f209458073'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.633648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:02.634307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb7ae4c22d44e558ad9e5f209458073'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.634508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.634791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.635061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] PATH_INFO: `/v3/projects/6f4750094a83458187c373f364199dac` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.636776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4750094a83458187c373f364199dac)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:02.638735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:02.643910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4fb36da0-d640-4c15-8ab6-3de9baced46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb7ae4c22d44e558ad9e5f209458073'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.649923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 957/1884] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:02 2022] DELETE /identity/v3/users/4bb7ae4c22d44e558ad9e5f209458073 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:02.694548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4750094a83458187c373f364199dac', 'request_id': 'req-01059506-a51c-435a-b077-8cca5d3cec52'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.704687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4750094a83458187c373f364199dac', 'request_id': 'req-01059506-a51c-435a-b077-8cca5d3cec52'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.714789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4750094a83458187c373f364199dac', 'request_id': 'req-01059506-a51c-435a-b077-8cca5d3cec52'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.727677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] The token cache is being invalidate because project 6f4750094a83458187c373f364199dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:02.728201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.728855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-01059506-a51c-435a-b077-8cca5d3cec52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:02.731013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 928/1885] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:02 2022] DELETE /identity/v3/projects/6f4750094a83458187c373f364199dac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:02.736709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.737098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.737447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.755437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:02.756742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:02.817162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 958/1886] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:02.824924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.825215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.825498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.843757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:02.844954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:02.856871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 929/1887] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:02.858381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.874863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e9dd-b202-4b98-b079-a3918816c06b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:02.891201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:02.892033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.893071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.893714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.894578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:02.895036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:02.896622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:02.911578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 959/1888] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:02.915874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.925520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd12e8-57bb-4588-8a80-1f19dcad8ce8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:02.930522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:02.931232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:02.931516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:02.931791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:02.932490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:02.934952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:02.959844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 930/1889] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:02 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:02.964540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:02.974583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6e01-e729-43e4-93b4-bffa59ff06a4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.032908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.033912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.034145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.034510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.035219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.037930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.051693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.053532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.064037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 960/1890] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:02 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:03.067837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.081278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7b9cf-bf80-4087-8bbc-b93f72cf2294 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.081278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.081278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.081278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.081742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] PATH_INFO: `/v3/projects/2e2175db13cd4b7eb5d346733eb2a502` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.081742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2175db13cd4b7eb5d346733eb2a502)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.082632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0a7b-ada2-4b90-8b7b-4e43f18543b4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.083008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.089929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.090992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.091342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.091753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.097666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.097666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.105293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 961/1891] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:03.109205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.118990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebaa1c-3271-493a-a959-931388ab8964 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.124669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.125317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.125628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.125903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.126618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.128182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.137526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2175db13cd4b7eb5d346733eb2a502', 'request_id': 'req-220738aa-2d15-4db5-84ff-b60fef08aba8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.138989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 962/1892] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:03.142935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.147927 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2175db13cd4b7eb5d346733eb2a502', 'request_id': 'req-220738aa-2d15-4db5-84ff-b60fef08aba8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.153030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22233c-2067-435e-b5d7-eb2bcf9331ab admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.155350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2175db13cd4b7eb5d346733eb2a502', 'request_id': 'req-220738aa-2d15-4db5-84ff-b60fef08aba8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.165570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] The token cache is being invalidate because project 2e2175db13cd4b7eb5d346733eb2a502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:03.165860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.166509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-220738aa-2d15-4db5-84ff-b60fef08aba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.168647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 931/1893] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:03 2022] DELETE /identity/v3/projects/2e2175db13cd4b7eb5d346733eb2a502 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:03.173236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0963240-b0fa-40ae-8969-4dbc0ab089e3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.173605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0963240-b0fa-40ae-8969-4dbc0ab089e3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.173951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0963240-b0fa-40ae-8969-4dbc0ab089e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.190545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c0963240-b0fa-40ae-8969-4dbc0ab089e3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:03.191764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c0963240-b0fa-40ae-8969-4dbc0ab089e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.207708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb68a0-305b-4d29-95ad-2484689f75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.208593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb68a0-305b-4d29-95ad-2484689f75e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.208874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb68a0-305b-4d29-95ad-2484689f75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.209145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb68a0-305b-4d29-95ad-2484689f75e9 admin admin] PATH_INFO: `/v3/projects/2ca7c59ebe214406a9002788a652c24b/users/53ee4e407a7f4b11b3aeac8579cb651d/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.223498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb68a0-305b-4d29-95ad-2484689f75e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca7c59ebe214406a9002788a652c24b, user_id=53ee4e407a7f4b11b3aeac8579cb651d, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.226259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb68a0-305b-4d29-95ad-2484689f75e9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.239152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 963/1894] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:03 2022] PUT /identity/v3/projects/2ca7c59ebe214406a9002788a652c24b/users/53ee4e407a7f4b11b3aeac8579cb651d/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:03.249489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.249804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.250077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.252490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 932/1895] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:03.259951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.260244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.260526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.280049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] MFA Rules not processed for user `53ee4e407a7f4b11b3aeac8579cb651d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:03.281294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.282953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:03.285269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.346831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 964/1896] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:03.354321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 933/1897] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:03.358498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.358726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.360194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.368258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da88dc3-0b81-4ad2-827e-7168e7cea647 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.373917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.374670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.375025 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.375374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.376208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:03.376688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.379277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.391637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 934/1898] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:03.396039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.406077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef407c9-de17-4bda-898f-92d3b9742846 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.411153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.411787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.412073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.412352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.413030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.414955 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.415881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d79a-bc92-44df-bda0-75e5c72e3788 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.420136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.420779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.421059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.421362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.429610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.431034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.440875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 965/1899] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:03.441094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 935/1900] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:03.444939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.455320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715eb0-6c03-4f6e-b4f8-9f80d51fdb59 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.461548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.463235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.512969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.513670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.513962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.514244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.514945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.516862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.528201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3e827-1337-44ec-8557-f0744ee0b0c7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.533156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.534330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.534612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.534887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] PATH_INFO: `/v3/users/53ee4e407a7f4b11b3aeac8579cb651d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.536086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ee4e407a7f4b11b3aeac8579cb651d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.539829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 966/1901] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:03.539949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.540833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.550738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02109685-4146-4c20-a80a-ef377bf874a4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.555364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.556003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.556285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.556558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.557281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.559479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.570712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 967/1902] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:03.574954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.584526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385497b-a3ea-4f2c-b114-4282e7139af7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.585133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ee4e407a7f4b11b3aeac8579cb651d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.589964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.590610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.590871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.591146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.591862 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.593406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.597049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ee4e407a7f4b11b3aeac8579cb651d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.597765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ee4e407a7f4b11b3aeac8579cb651d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.603050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 968/1903] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:03.604393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ee4e407a7f4b11b3aeac8579cb651d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.607034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.612445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16a666e5-fc3c-497e-af39-6b1662ae0edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ee4e407a7f4b11b3aeac8579cb651d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:03.618572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac43d2-7199-4859-ab98-5995cf3a00fc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.621742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 936/1904] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:03 2022] DELETE /identity/v3/users/53ee4e407a7f4b11b3aeac8579cb651d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:03.624264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224e4a-77ea-45b2-a32b-85923787e578 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.624559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224e4a-77ea-45b2-a32b-85923787e578 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.624846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224e4a-77ea-45b2-a32b-85923787e578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.642726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-15224e4a-77ea-45b2-a32b-85923787e578 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:03.643952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-15224e4a-77ea-45b2-a32b-85923787e578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.685744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.686794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.687170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.687587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] PATH_INFO: `/v3/projects/5172c7bdfef847f7b181cd59cdd982d3/users/6ec48b2a0b92456e9a046634fa49e6bf/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.710564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5172c7bdfef847f7b181cd59cdd982d3, user_id=6ec48b2a0b92456e9a046634fa49e6bf, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.713614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.730089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 937/1905] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:03.730177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 969/1906] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:03 2022] PUT /identity/v3/projects/5172c7bdfef847f7b181cd59cdd982d3/users/6ec48b2a0b92456e9a046634fa49e6bf/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:03.735708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.736236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.736530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.736813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.737613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.755103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:03.756407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.816086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2742-4a43-43eb-895b-b065fa9894f7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.821815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de6b3-9a69-41fd-85e1-faf07e12f4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.822737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de6b3-9a69-41fd-85e1-faf07e12f4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.822737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de6b3-9a69-41fd-85e1-faf07e12f4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.822737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de6b3-9a69-41fd-85e1-faf07e12f4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.848598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 938/1907] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:03.859676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:03.861108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:03.873866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c2a21-77dc-40c1-9c6c-f8cc164ec57e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:03.878354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:03.879186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:03.879654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:03.879906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:03.890822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.892330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.896649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de6b3-9a69-41fd-85e1-faf07e12f4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:03.898257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de6b3-9a69-41fd-85e1-faf07e12f4d7 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:03.902326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 939/1908] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:03.908625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 970/1909] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:04.446949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:04.449268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:04.463557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741e34-ed5f-49f9-8d76-a9c2b5a4b91f service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:04.469102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:04.470153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:04.470451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:04.470725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] PATH_INFO: `/v3/projects/2ca7c59ebe214406a9002788a652c24b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:04.471986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca7c59ebe214406a9002788a652c24b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:04.474029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:04.543029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca7c59ebe214406a9002788a652c24b', 'request_id': 'req-26a7c73d-9715-4a9f-a608-57ad0bc8451d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:04.552472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca7c59ebe214406a9002788a652c24b', 'request_id': 'req-26a7c73d-9715-4a9f-a608-57ad0bc8451d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:04.560948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca7c59ebe214406a9002788a652c24b', 'request_id': 'req-26a7c73d-9715-4a9f-a608-57ad0bc8451d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:04.575868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] The token cache is being invalidate because project 2ca7c59ebe214406a9002788a652c24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:04.576310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:04.577689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-26a7c73d-9715-4a9f-a608-57ad0bc8451d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:04.579638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 940/1910] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:04 2022] DELETE /identity/v3/projects/2ca7c59ebe214406a9002788a652c24b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:04.584428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:04.585043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:04.585338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:04.614592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:04.615851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:04.714973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 971/1911] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:04.722949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:04.723448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:04.723750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:04.756099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:04.758318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:04.771990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 941/1912] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:04.777822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:04.789107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0511f-89ac-4b50-b7a3-8415df3d7b60 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:04.797895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:04.798576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:04.798857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:04.799305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:04.800041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:04.800350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:04.801992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:04.819270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 972/1913] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:04.820381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:04.832944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a185-fa96-4dfb-aa38-21305d61353a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:04.841419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc91a-d09a-4c3e-9975-28752c9a55e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:04.847778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc91a-d09a-4c3e-9975-28752c9a55e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:04.848070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc91a-d09a-4c3e-9975-28752c9a55e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:04.848357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc91a-d09a-4c3e-9975-28752c9a55e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:04.849517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc91a-d09a-4c3e-9975-28752c9a55e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:04.851624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc91a-d09a-4c3e-9975-28752c9a55e1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:04.887210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 942/1914] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:04 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:04.891592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:04.915178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfed4b-b7e6-4509-8aa2-8116c976a335 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:04.933262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:04.933549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:04.934060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:04.992931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] MFA Rules not processed for user `6ec48b2a0b92456e9a046634fa49e6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:04.994191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:05.020001 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.020685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.020968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.021245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.022973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.024975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.057966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 973/1915] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:04 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:05.058948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.072783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d066e-83e3-4fd1-a85e-71b9e6a9fbfd admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.081959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.082644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.082931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.083223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.083948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.085205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 943/1916] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:05.085583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.090766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.095604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:05.099605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 974/1917] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:05.104419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.118273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7d64-0c33-49cd-b2f9-a0992d49f434 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.123728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68827-f25c-41a2-9370-119b00514eb9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.124422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.125825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.126252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.126695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.127526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.129034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.129732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.130017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.130298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.131023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.131693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.132641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.153960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 975/1918] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:05.157684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.168380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 944/1919] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:05 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:05.168380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.168968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8ccbb-35c8-4fb5-9070-8687bcb0ccde admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.235003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4a8c4-caa5-4366-a3fc-c55dcaa1c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.235868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4a8c4-caa5-4366-a3fc-c55dcaa1c2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.236144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4a8c4-caa5-4366-a3fc-c55dcaa1c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.236414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4a8c4-caa5-4366-a3fc-c55dcaa1c2b3 admin admin] PATH_INFO: `/v3/projects/b4cfe7ea90334d0396a900370b7c6ad1/users/4d40963d915f40ac9ba906cc506ef211/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.252815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4a8c4-caa5-4366-a3fc-c55dcaa1c2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4cfe7ea90334d0396a900370b7c6ad1, user_id=4d40963d915f40ac9ba906cc506ef211, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.256407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4a8c4-caa5-4366-a3fc-c55dcaa1c2b3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.256814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3746-3411-4214-a9cc-37dd7641fb75 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.262589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.263252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.263532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.263808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.264802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.266452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.272563 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 976/1920] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:05 2022] PUT /identity/v3/projects/b4cfe7ea90334d0396a900370b7c6ad1/users/4d40963d915f40ac9ba906cc506ef211/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:05.283784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.284069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.284345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.293901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 945/1921] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:05 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:05.297782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.308655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0459d-67dd-43f3-a703-191e6b932118 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.314975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] MFA Rules not processed for user `4d40963d915f40ac9ba906cc506ef211`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:05.316260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:05.377286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.378021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.378301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.378576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.382584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.384867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 977/1922] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:05.385529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.396520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 946/1923] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:05.396644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.398037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:05.402891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.413473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6d9d0-a4d0-4b68-add8-9cf84f9cb2a0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.427205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.428112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.428418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.428670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] PATH_INFO: `/v3/projects/b09226da6f424a838c4734f707662aef/users/c79ca0b28a424b5db0edd83a1fcb29c7/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.445165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09226da6f424a838c4734f707662aef, user_id=c79ca0b28a424b5db0edd83a1fcb29c7, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.447868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.465035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 947/1924] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:05 2022] PUT /identity/v3/projects/b09226da6f424a838c4734f707662aef/users/c79ca0b28a424b5db0edd83a1fcb29c7/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:05.469840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.474521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcd35c-d713-4320-865e-e0fabfcd9b1b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.545752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e790-162e-4e12-bcfa-fc4285566b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.546413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e790-162e-4e12-bcfa-fc4285566b3c service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.546746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e790-162e-4e12-bcfa-fc4285566b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.547025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e790-162e-4e12-bcfa-fc4285566b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.554389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfeabd-e209-4b23-b9de-4ec7bb03d6eb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.559828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.560505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.560792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.561069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.561849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.563657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.579159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 948/1925] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:05.583334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:05.605462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476791-630d-46d9-9b3e-6255b8d33d62 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:05.610698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:05.611756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:05.612036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:05.612314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] PATH_INFO: `/v3/projects/b09226da6f424a838c4734f707662aef/users/c79ca0b28a424b5db0edd83a1fcb29c7/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:05.614434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09226da6f424a838c4734f707662aef, user_id=c79ca0b28a424b5db0edd83a1fcb29c7, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.617093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e790-162e-4e12-bcfa-fc4285566b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:05.617543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.618559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e790-162e-4e12-bcfa-fc4285566b3c service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:05.627988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 978/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:05.635013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 949/1927] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:05 2022] PUT /identity/v3/projects/b09226da6f424a838c4734f707662aef/users/c79ca0b28a424b5db0edd83a1fcb29c7/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:06.310282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:06.310574 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:06.310856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:06.340987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] MFA Rules not processed for user `c79ca0b28a424b5db0edd83a1fcb29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:06.342236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:06.417523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 979/1928] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:06.429856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:06.494643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06dec3-4923-4f28-bca8-f8996898a8e2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:06.498996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:06.499677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:06.499983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:06.500294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:06.555324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:06.556769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:06.566094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 950/1929] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:09.110324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:09.111836 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:09.127787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555764-7a59-46ec-a284-6f6727ff9642 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:09.131736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf47d48-b813-4ccf-a36f-cca87d7b9b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:09.132404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47d48-b813-4ccf-a36f-cca87d7b9b4f service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:09.132927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47d48-b813-4ccf-a36f-cca87d7b9b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:09.133377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47d48-b813-4ccf-a36f-cca87d7b9b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:09.148736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf47d48-b813-4ccf-a36f-cca87d7b9b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:09.150273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf47d48-b813-4ccf-a36f-cca87d7b9b4f service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:09.165204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 980/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:11.168722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:11.237861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171c660-2c85-461e-a6b0-32a48df5e0e5 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:11.243130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:11.244005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:11.244304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:11.244579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] PATH_INFO: `/v3/users/4d40963d915f40ac9ba906cc506ef211` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:11.245815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d40963d915f40ac9ba906cc506ef211)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:11.247876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:11.301780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d40963d915f40ac9ba906cc506ef211'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:11.314232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d40963d915f40ac9ba906cc506ef211'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:11.315314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d40963d915f40ac9ba906cc506ef211'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:11.322029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d40963d915f40ac9ba906cc506ef211'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:11.329164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d40963d915f40ac9ba906cc506ef211'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:11.335897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 951/1931] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:11 2022] DELETE /identity/v3/users/4d40963d915f40ac9ba906cc506ef211 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:11.340878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:11.341334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:11.341486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:11.360793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:11.362156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:11.419216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 981/1932] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:11.428742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:11.430172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:11.492645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efc38-3399-49c1-9b6e-93ee9c3983c5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:11.496622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:11.497262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:11.497547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:11.497921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:11.514445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:11.516445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:11.529613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 952/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:11.926777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:11.928222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:11.941264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da9d9-f658-4e37-ba48-ab147d83b136 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:11.946803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:11.958198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:11.958717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:11.959157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] PATH_INFO: `/v3/projects/b4cfe7ea90334d0396a900370b7c6ad1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:11.961130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4cfe7ea90334d0396a900370b7c6ad1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:11.963265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:12.016238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4cfe7ea90334d0396a900370b7c6ad1', 'request_id': 'req-92b91919-b450-4776-945d-ccd5ac83e55b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:12.027221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4cfe7ea90334d0396a900370b7c6ad1', 'request_id': 'req-92b91919-b450-4776-945d-ccd5ac83e55b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:12.034743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4cfe7ea90334d0396a900370b7c6ad1', 'request_id': 'req-92b91919-b450-4776-945d-ccd5ac83e55b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:12.047670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] The token cache is being invalidate because project b4cfe7ea90334d0396a900370b7c6ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:12.048046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:12.049013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-92b91919-b450-4776-945d-ccd5ac83e55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:12.050941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 982/1934] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:11 2022] DELETE /identity/v3/projects/b4cfe7ea90334d0396a900370b7c6ad1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:21.621415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:21.623353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:21.635657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005ced-cf59-4916-8428-38e88b68305b service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:21.689105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:21.690011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:21.690287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:21.690605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] PATH_INFO: `/v3/users/8c3d3829976a498f82c3bbca5b34ba67` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:21.691772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3d3829976a498f82c3bbca5b34ba67)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:21.694007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:21.738956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3d3829976a498f82c3bbca5b34ba67'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:21.752288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3d3829976a498f82c3bbca5b34ba67'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:21.753041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3d3829976a498f82c3bbca5b34ba67'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:21.760364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3d3829976a498f82c3bbca5b34ba67'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:21.768199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3d3829976a498f82c3bbca5b34ba67'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:21.774356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 953/1935] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:21 2022] DELETE /identity/v3/users/8c3d3829976a498f82c3bbca5b34ba67 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:21.778929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:21.779429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:21.779549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:21.797162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:21.799138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:21.865045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 983/1936] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:21.876600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:21.878367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:21.951695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943024c2-7e2c-4383-9b4e-d32a0a8f1801 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:21.956673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e76e1-1b70-4af5-91de-1fe99416c542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:21.956811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e76e1-1b70-4af5-91de-1fe99416c542 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:21.957155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e76e1-1b70-4af5-91de-1fe99416c542 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:21.957508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e76e1-1b70-4af5-91de-1fe99416c542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:21.969003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e76e1-1b70-4af5-91de-1fe99416c542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:21.970610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e76e1-1b70-4af5-91de-1fe99416c542 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:21.982798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 954/1937] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:21.991505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:21.993545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:22.011615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b16a4-6b86-4a14-8c0a-159651f123f7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:22.016758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:22.017903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:22.018434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:22.018775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] PATH_INFO: `/v3/users/9b932314ea964cc39c91d4731af99b41` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:22.019956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b932314ea964cc39c91d4731af99b41)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:22.021926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:22.069475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b932314ea964cc39c91d4731af99b41'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.081404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b932314ea964cc39c91d4731af99b41'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.088639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b932314ea964cc39c91d4731af99b41'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.089284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b932314ea964cc39c91d4731af99b41'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.097217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b932314ea964cc39c91d4731af99b41'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.103487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 984/1938] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:21 2022] DELETE /identity/v3/users/9b932314ea964cc39c91d4731af99b41 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:22.108619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:22.108911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:22.109189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:22.131561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:22.132790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:22.211036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 955/1939] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:22.218558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:22.219969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:22.287728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2786fba-755a-42fd-957f-612ac81bf050 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:22.291852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:22.292617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:22.292990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:22.293493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:22.308329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:22.309943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:22.334682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e98f93-4bb0-4c66-9556-f487a573ec5c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:22.341208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:22.345057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:22.359724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 985/1940] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:22.364868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:22.365888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:22.366054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:22.366326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] PATH_INFO: `/v3/projects/5ae8db6fef4c472db290c2be42e944de` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:22.368193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae8db6fef4c472db290c2be42e944de)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:22.370571 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:22.443076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae8db6fef4c472db290c2be42e944de', 'request_id': 'req-fa7def6d-f075-450d-89ac-937a82afc40b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.458229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae8db6fef4c472db290c2be42e944de', 'request_id': 'req-fa7def6d-f075-450d-89ac-937a82afc40b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.468579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae8db6fef4c472db290c2be42e944de', 'request_id': 'req-fa7def6d-f075-450d-89ac-937a82afc40b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.480698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] The token cache is being invalidate because project 5ae8db6fef4c472db290c2be42e944de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:22.480975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.482467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.484152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 956/1941] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:22 2022] DELETE /identity/v3/projects/5ae8db6fef4c472db290c2be42e944de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:22.488185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:22.498349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfeba-98e9-44b5-88a0-59b8066a73fc service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:22.578506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:22.579828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:22.580178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:22.580527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] PATH_INFO: `/v3/users/71d697e1464947a1900018d9496753a0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:22.582380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d697e1464947a1900018d9496753a0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:22.586344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:22.665189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d697e1464947a1900018d9496753a0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.678197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d697e1464947a1900018d9496753a0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.686744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d697e1464947a1900018d9496753a0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.687444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d697e1464947a1900018d9496753a0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.694519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c556b205-8ad8-4e39-b5c4-f5c33ceec103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d697e1464947a1900018d9496753a0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:22.702332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 986/1942] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:22 2022] DELETE /identity/v3/users/71d697e1464947a1900018d9496753a0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:23.012512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.014605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:23.034142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7def6d-f075-450d-89ac-937a82afc40b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.101640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.103048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.103811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.104258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] PATH_INFO: `/v3/projects/b4598bdefb384e479bf1f2af07a19b33` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.109756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4598bdefb384e479bf1f2af07a19b33)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.111764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.181004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4598bdefb384e479bf1f2af07a19b33', 'request_id': 'req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.195242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4598bdefb384e479bf1f2af07a19b33', 'request_id': 'req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.204207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4598bdefb384e479bf1f2af07a19b33', 'request_id': 'req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.215829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] The token cache is being invalidate because project b4598bdefb384e479bf1f2af07a19b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:23.216199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.217022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.222452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 957/1943] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:23 2022] DELETE /identity/v3/projects/b4598bdefb384e479bf1f2af07a19b33 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:23.225046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa441-1c91-44c1-8f76-9bbee6021635 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.226717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa441-1c91-44c1-8f76-9bbee6021635 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.227296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa441-1c91-44c1-8f76-9bbee6021635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.248426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.250075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:23.287221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e95aa441-1c91-44c1-8f76-9bbee6021635 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:23.288690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e95aa441-1c91-44c1-8f76-9bbee6021635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:23.326706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa375a-beaa-43c8-92a0-ef593fe4e0c2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.332576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.333440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.333777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.334054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] PATH_INFO: `/v3/projects/6135aef7c82a4e359d338c2f2aceba15` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.335298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6135aef7c82a4e359d338c2f2aceba15)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.337287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.359328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 987/1944] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:23.366922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.367167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.367443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.385664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:23.386864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:23.387942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6135aef7c82a4e359d338c2f2aceba15', 'request_id': 'req-51025961-e171-4b0b-a751-d7bf561b52f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.396372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6135aef7c82a4e359d338c2f2aceba15', 'request_id': 'req-51025961-e171-4b0b-a751-d7bf561b52f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.402765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6135aef7c82a4e359d338c2f2aceba15', 'request_id': 'req-51025961-e171-4b0b-a751-d7bf561b52f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.413346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] The token cache is being invalidate because project 6135aef7c82a4e359d338c2f2aceba15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:23.413657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.414328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-51025961-e171-4b0b-a751-d7bf561b52f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:23.416132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 958/1945] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:23 2022] DELETE /identity/v3/projects/6135aef7c82a4e359d338c2f2aceba15 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:23.421234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad46b5-518c-41ca-9249-9052af053796 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.421517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad46b5-518c-41ca-9249-9052af053796 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.421821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad46b5-518c-41ca-9249-9052af053796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.440089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f5ad46b5-518c-41ca-9249-9052af053796 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:23.441281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f5ad46b5-518c-41ca-9249-9052af053796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:23.457376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 988/1946] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:23.459005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.469138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0c2d-c10d-48c5-8461-ceecf9ff5f26 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.474111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.474988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.475437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.475863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.476583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:23.476886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.478503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.493145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 989/1947] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:23.498066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.501378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 959/1948] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:23.509945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.510234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.510510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.513866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fbc3e-c7b2-493f-886d-8e7a33a6cf60 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.518767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.519597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.520040 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.520324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.521034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.523174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.528725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:23.530035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:23.539910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 960/1949] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:23.544308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.553195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3cb3b-81bb-4803-be02-14b3dccc4c04 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.554386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 990/1950] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:23.558324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.616920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.617619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.617902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.618177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.618904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:23.619210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.623608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.637306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5535d-892b-4e45-b0a9-a0a512ce2b3e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.645409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 961/1951] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:23.647286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528816f7-5562-4582-977c-464846e62960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.648082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528816f7-5562-4582-977c-464846e62960 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.648471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528816f7-5562-4582-977c-464846e62960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.648847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528816f7-5562-4582-977c-464846e62960 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.649382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.650460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528816f7-5562-4582-977c-464846e62960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.652516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528816f7-5562-4582-977c-464846e62960 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.666719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f624a96-7106-448b-9dfe-5685a738291c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.673591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.674309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.674591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.674921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.675953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.678110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.682397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 991/1952] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:23.692083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528816f7-5562-4582-977c-464846e62960 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.713415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528816f7-5562-4582-977c-464846e62960 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.720221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 962/1953] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:23.720370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.721232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.721517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.721863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.722657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.724270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.731008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.738814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 992/1954] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:23.740503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.756934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aa4e3-ae89-45d7-aea4-7b8adb265f9a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.834708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe6f8-f847-4128-a1b1-c417ea1793c0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.843945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.846088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.846315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.847778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.849315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.851408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.882800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 963/1955] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:23 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:23.887128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.902211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786e10-2ea6-4232-9ee3-e0d695a9823e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.909309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.910026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.910313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.910594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.912129 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.917463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.918294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.919650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.920634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.921418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.923130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.924869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.932152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 964/1956] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:23.935852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.948377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 993/1957] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:23.952421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5942ed-e6c0-412a-8d93-165f47f95ad2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.953422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.960673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.961496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.961876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.962839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.963034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:23.965198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:23.973714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dbcb1-7f7e-47cd-907c-d14ad57c8d86 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:23.978716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac250f-bada-40af-bb74-79ed52654645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:23.979548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 965/1958] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:23.983476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac250f-bada-40af-bb74-79ed52654645 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:23.983769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac250f-bada-40af-bb74-79ed52654645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:23.984070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac250f-bada-40af-bb74-79ed52654645 admin admin] PATH_INFO: `/v3/projects/f38d2d8f8ff747b09236f39361d09569/users/9b3e34e4f86b4acbbd89a93c3aa384e6/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:23.984493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:23.995220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f307b9-f9b4-4825-ab44-21b27b6e5328 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.000657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac250f-bada-40af-bb74-79ed52654645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38d2d8f8ff747b09236f39361d09569, user_id=9b3e34e4f86b4acbbd89a93c3aa384e6, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.001076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8a427-59e9-42d7-af1a-4c4e17b65a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.002013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a427-59e9-42d7-af1a-4c4e17b65a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.002464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a427-59e9-42d7-af1a-4c4e17b65a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.002583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a427-59e9-42d7-af1a-4c4e17b65a07 admin admin] PATH_INFO: `/v3/projects/9f0d56bfaa63437f9fd46764d5659862/users/59470153a65143c58b0a9ea79956622e/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.004512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac250f-bada-40af-bb74-79ed52654645 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.018983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8a427-59e9-42d7-af1a-4c4e17b65a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0d56bfaa63437f9fd46764d5659862, user_id=59470153a65143c58b0a9ea79956622e, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.021976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8a427-59e9-42d7-af1a-4c4e17b65a07 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.025599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 994/1959] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:23 2022] PUT /identity/v3/projects/f38d2d8f8ff747b09236f39361d09569/users/9b3e34e4f86b4acbbd89a93c3aa384e6/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:24.037518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.038194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.038705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.046809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 966/1960] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:23 2022] PUT /identity/v3/projects/9f0d56bfaa63437f9fd46764d5659862/users/59470153a65143c58b0a9ea79956622e/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:24.052201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.052562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.052908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.072708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] MFA Rules not processed for user `9b3e34e4f86b4acbbd89a93c3aa384e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:24.074365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:24.075763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:24.077604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:24.146257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 967/1961] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:24.155976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.157859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:24.166786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 995/1962] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:24.171224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.182254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36a19c-3c4a-4d6a-9a0a-8d321ff0f893 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.187392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.188180 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.188576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.189229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.190329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.192834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.223326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3ee8-9842-4da3-9e31-d611ebfce366 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.226078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 996/1963] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:24 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:24.227206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.286951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.288074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.288357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.288636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.305820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f48d9f-b7f0-4dc0-b29e-37f3a7f2ff4e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.313136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.314006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.314294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.314563 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.315257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.317184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.357418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 997/1964] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:24 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:24.358529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.394834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ffcf1-cc6a-4671-9224-2711e717ea2e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.400984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.402971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.410294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.411221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.411354 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.411510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.412256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.415558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.419309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 968/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:24.432081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 998/1966] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:24.436364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.447032 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d94d-f444-458e-9913-9d188145f988 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.454414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.455303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.455588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.455867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] PATH_INFO: `/v3/projects/5bb58b5b31ff4c388200a9be423771fe/users/dd48fa888c784d848d328cfb2b1f626c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.472736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb58b5b31ff4c388200a9be423771fe, user_id=dd48fa888c784d848d328cfb2b1f626c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.475475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.490378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 969/1967] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:24 2022] PUT /identity/v3/projects/5bb58b5b31ff4c388200a9be423771fe/users/dd48fa888c784d848d328cfb2b1f626c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:24.494420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.505646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ed48a-a17f-4a1d-a9cc-9f74e2c28296 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.574085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e888b3d-f76b-48b6-b5a9-04d78ecd7e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.574968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e888b3d-f76b-48b6-b5a9-04d78ecd7e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.575549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e888b3d-f76b-48b6-b5a9-04d78ecd7e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.575932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e888b3d-f76b-48b6-b5a9-04d78ecd7e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.576919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e888b3d-f76b-48b6-b5a9-04d78ecd7e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.579491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e888b3d-f76b-48b6-b5a9-04d78ecd7e0e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.591181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 999/1968] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:24.595421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.605846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5420c-9d59-4226-97ba-6448335fe15d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.610842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.611729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.612012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.612286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] PATH_INFO: `/v3/projects/5bb58b5b31ff4c388200a9be423771fe/users/dd48fa888c784d848d328cfb2b1f626c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.614326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb58b5b31ff4c388200a9be423771fe, user_id=dd48fa888c784d848d328cfb2b1f626c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.622500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.645177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 970/1969] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:24 2022] PUT /identity/v3/projects/5bb58b5b31ff4c388200a9be423771fe/users/dd48fa888c784d848d328cfb2b1f626c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:24.647591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.647912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.648162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.678796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] MFA Rules not processed for user `dd48fa888c784d848d328cfb2b1f626c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:24.680143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:24.781628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1000/1970] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:24.800714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:24.802638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:24.897528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f807044-43b3-4c0c-9c50-b8ba69c24732 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:24.910372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904120a-baf7-4209-b338-8df7ecdf6462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:24.913042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904120a-baf7-4209-b338-8df7ecdf6462 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:24.913512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904120a-baf7-4209-b338-8df7ecdf6462 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:24.913964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904120a-baf7-4209-b338-8df7ecdf6462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:24.933453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904120a-baf7-4209-b338-8df7ecdf6462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:24.935989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904120a-baf7-4209-b338-8df7ecdf6462 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:24.974490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 971/1971] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:25.077447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:25.089510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efe334-b912-4416-a575-c564bc4ddaba None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:25.094930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:25.096231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:25.096716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:25.097170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:25.244185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:25.247019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:25.271653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1001/1972] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:26.015409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9ccd-d4f0-47c7-82b0-1f071059f16d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:26.015908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9ccd-d4f0-47c7-82b0-1f071059f16d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:26.016018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9ccd-d4f0-47c7-82b0-1f071059f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:26.044815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-101c9ccd-d4f0-47c7-82b0-1f071059f16d None None] MFA Rules not processed for user `59470153a65143c58b0a9ea79956622e`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:26.046375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-101c9ccd-d4f0-47c7-82b0-1f071059f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:26.125574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 972/1973] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:26.139052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:26.147735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff23e-d7e6-4183-992b-2f0518e776cb service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:26.152553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:26.153481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:26.153880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:26.154223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:26.164189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:26.165805 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:26.186192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1002/1974] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:27.551325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:27.551886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:27.552009 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:27.570580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] MFA Rules not processed for user `59470153a65143c58b0a9ea79956622e`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:27.571808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:27.579480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 973/1975] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:29.703543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:29.705153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:29.827053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd741f-e602-40a0-9c3f-6fb0f627f6dd service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:29.841882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:29.842795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:29.843086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:29.843359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] PATH_INFO: `/v3/users/6ec48b2a0b92456e9a046634fa49e6bf` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:29.845549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec48b2a0b92456e9a046634fa49e6bf)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:29.848053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:29.914333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec48b2a0b92456e9a046634fa49e6bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:29.938757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec48b2a0b92456e9a046634fa49e6bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:29.949339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec48b2a0b92456e9a046634fa49e6bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:29.950513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec48b2a0b92456e9a046634fa49e6bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:29.958614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec48b2a0b92456e9a046634fa49e6bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:29.964642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1003/1976] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:29 2022] DELETE /identity/v3/users/6ec48b2a0b92456e9a046634fa49e6bf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:30.160157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:30.176473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5314e5-c22b-4dd2-b955-0f359bcb7121 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:30.250848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:30.251750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.252042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.252324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] PATH_INFO: `/v3/projects/5172c7bdfef847f7b181cd59cdd982d3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.253754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5172c7bdfef847f7b181cd59cdd982d3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:30.255767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:30.303587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:30.305227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:30.320019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be0e8b-b314-458b-899d-7e720d8a6852 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:30.321940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5172c7bdfef847f7b181cd59cdd982d3', 'request_id': 'req-99f90591-ddfb-45ce-9e3b-3236df9785cb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.330655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5172c7bdfef847f7b181cd59cdd982d3', 'request_id': 'req-99f90591-ddfb-45ce-9e3b-3236df9785cb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.337336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5172c7bdfef847f7b181cd59cdd982d3', 'request_id': 'req-99f90591-ddfb-45ce-9e3b-3236df9785cb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.348918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] The token cache is being invalidate because project 5172c7bdfef847f7b181cd59cdd982d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:30.349723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.350601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.352353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 974/1977] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:30 2022] DELETE /identity/v3/projects/5172c7bdfef847f7b181cd59cdd982d3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:30.356739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:30.358243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:30.381398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:30.382599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.383020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.383352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] PATH_INFO: `/v3/users/fcace2ff87004618aa24c6cd2f457d01` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.385267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcace2ff87004618aa24c6cd2f457d01)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:30.387404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:30.425942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f90591-ddfb-45ce-9e3b-3236df9785cb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:30.436047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:30.437024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcace2ff87004618aa24c6cd2f457d01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.437144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.437676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.437676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] PATH_INFO: `/v3/users/c79ca0b28a424b5db0edd83a1fcb29c7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.438943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79ca0b28a424b5db0edd83a1fcb29c7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:30.441113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:30.451369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcace2ff87004618aa24c6cd2f457d01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.459411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcace2ff87004618aa24c6cd2f457d01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.460346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcace2ff87004618aa24c6cd2f457d01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.468459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcace2ff87004618aa24c6cd2f457d01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.478825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1004/1978] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:30 2022] DELETE /identity/v3/users/fcace2ff87004618aa24c6cd2f457d01 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:30.499817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79ca0b28a424b5db0edd83a1fcb29c7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.512374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79ca0b28a424b5db0edd83a1fcb29c7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.513343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79ca0b28a424b5db0edd83a1fcb29c7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.521063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79ca0b28a424b5db0edd83a1fcb29c7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.531188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79ca0b28a424b5db0edd83a1fcb29c7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.539510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 975/1979] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:30 2022] DELETE /identity/v3/users/c79ca0b28a424b5db0edd83a1fcb29c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:30.685786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:30.687243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:30.748563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:30.749999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:30.763887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25340cd-7686-4e3d-bb46-910be03b5726 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:30.817408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e14db-2cff-4024-affb-c1cc06cbd96b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:30.825346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:30.826876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.827166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.827445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] PATH_INFO: `/v3/projects/b09226da6f424a838c4734f707662aef` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.828029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:30.828635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09226da6f424a838c4734f707662aef)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:30.828993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.829321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.829973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] PATH_INFO: `/v3/projects/41351d6d88eb41e2a1cda97d9f0c77a1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.830584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:30.831389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41351d6d88eb41e2a1cda97d9f0c77a1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:30.833807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:30.880629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09226da6f424a838c4734f707662aef', 'request_id': 'req-f6316bf2-3966-47ec-8e9f-dab564a3d734'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.881418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41351d6d88eb41e2a1cda97d9f0c77a1', 'request_id': 'req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.887676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09226da6f424a838c4734f707662aef', 'request_id': 'req-f6316bf2-3966-47ec-8e9f-dab564a3d734'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.890178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41351d6d88eb41e2a1cda97d9f0c77a1', 'request_id': 'req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.894133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09226da6f424a838c4734f707662aef', 'request_id': 'req-f6316bf2-3966-47ec-8e9f-dab564a3d734'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.897065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41351d6d88eb41e2a1cda97d9f0c77a1', 'request_id': 'req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.904668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] The token cache is being invalidate because project b09226da6f424a838c4734f707662aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:30.904945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.905604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f6316bf2-3966-47ec-8e9f-dab564a3d734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.907145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 976/1980] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:30 2022] DELETE /identity/v3/projects/b09226da6f424a838c4734f707662aef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:30.907664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] The token cache is being invalidate because project 41351d6d88eb41e2a1cda97d9f0c77a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:30.908209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.908933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fff39f4-f47b-4d25-b0ea-0a1662b3b8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:30.910740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1005/1981] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:30 2022] DELETE /identity/v3/projects/41351d6d88eb41e2a1cda97d9f0c77a1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:30.915063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078efb-ac08-4d91-ad24-c2136cbaef4c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.915203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fccc9-baf8-4b3d-a7c7-31eb082f1b30 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:30.915401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fccc9-baf8-4b3d-a7c7-31eb082f1b30 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.915497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078efb-ac08-4d91-ad24-c2136cbaef4c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:30.915674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fccc9-baf8-4b3d-a7c7-31eb082f1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.915783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078efb-ac08-4d91-ad24-c2136cbaef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:30.934467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-71078efb-ac08-4d91-ad24-c2136cbaef4c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:30.935678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-71078efb-ac08-4d91-ad24-c2136cbaef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:30.936196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3b6fccc9-baf8-4b3d-a7c7-31eb082f1b30 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:30.937424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3b6fccc9-baf8-4b3d-a7c7-31eb082f1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:30.995017 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 977/1982] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:31.001863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1006/1983] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:31.003022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.003311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.003611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.009251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.009537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.009845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.021789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:31.022981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:31.027307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:31.029053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:31.031624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 978/1984] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:31.035931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.037910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1007/1985] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:31.041704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.045107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcac592-c4a7-40a3-9c44-a26d67a5cdb6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.050093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.050715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2253-8edc-4b9c-815f-34529cc2000b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.050841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.051257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.051540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.052265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:31.052568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.054203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.055576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.056214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.056494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.056773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.057491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:31.057825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.059426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.066224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 979/1986] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:31.070699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.076104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1008/1987] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:31.079366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.082043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307b69d-c6ba-4fcd-b7a8-5f3dbb052d33 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.086838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.087503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.087784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.088060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.088750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.089310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d1f0-6cca-4d1d-b550-17223a8332ac admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.091291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.097648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.097648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.097648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.097648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.098043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.098461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.117389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 980/1988] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:31.121470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.128057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1009/1989] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:31.129014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.185196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753c08a-a082-44e6-a305-a72b64630bae admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.190050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.190711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.190994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.191267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.191953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.194079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.194487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb3e3-171e-4a12-8ed1-653224282cb0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.199118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.200301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.200583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.200886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.201581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.203500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.213897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 981/1990] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:31.218628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.223457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1010/1991] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:31.227256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.232005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cb9a-470f-4a58-8c76-8fb6084ddeed admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.236428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d6a9d-796b-4295-9172-2110924782c9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.236627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.237902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.238185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.238462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.239190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.240774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.240942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.241593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.241874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.242146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.242855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.244440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.251083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 982/1992] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:31.257431 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1011/1993] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:31.257600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.258404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.264803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4817-ae4e-4ec4-814f-1700be1c76d8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.268187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638e44-f05d-44b8-9b7f-022890facef4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.269464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.270143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.270427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.270703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.271407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.272975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.273098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.273702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.273982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.274256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.274960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.276486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.284077 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 983/1994] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:31.288141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.289587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1012/1995] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:31.292732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.298956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90419-2504-459d-bfd4-7ffe2a2405d8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.302064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67db4-874a-43a1-9459-ed199241594a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.303564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0dc1e-6963-4ced-b898-94083da3a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.304535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0dc1e-6963-4ced-b898-94083da3a0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.304821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0dc1e-6963-4ced-b898-94083da3a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.305132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0dc1e-6963-4ced-b898-94083da3a0bf admin admin] PATH_INFO: `/v3/projects/b799bf4001da4a0eaef3fa60f662ea76/users/22459be27d334dde85abf32e9bc69cba/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.306656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a664be-ee97-49de-b6cc-418e2804a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.307501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a664be-ee97-49de-b6cc-418e2804a425 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.307780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a664be-ee97-49de-b6cc-418e2804a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.308058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a664be-ee97-49de-b6cc-418e2804a425 admin admin] PATH_INFO: `/v3/projects/96ecf26c0a7542a688ff41fbb7d3e196/users/c0d9f3a32dec4f9a8d5d9e47c8b0a960/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.319815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0dc1e-6963-4ced-b898-94083da3a0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b799bf4001da4a0eaef3fa60f662ea76, user_id=22459be27d334dde85abf32e9bc69cba, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.322522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0dc1e-6963-4ced-b898-94083da3a0bf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.322779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a664be-ee97-49de-b6cc-418e2804a425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ecf26c0a7542a688ff41fbb7d3e196, user_id=c0d9f3a32dec4f9a8d5d9e47c8b0a960, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.326049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a664be-ee97-49de-b6cc-418e2804a425 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.336008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 984/1996] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:31 2022] PUT /identity/v3/projects/b799bf4001da4a0eaef3fa60f662ea76/users/22459be27d334dde85abf32e9bc69cba/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:31.338510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1013/1997] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:31 2022] PUT /identity/v3/projects/96ecf26c0a7542a688ff41fbb7d3e196/users/c0d9f3a32dec4f9a8d5d9e47c8b0a960/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:31.349772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.350069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.350361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.351220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.351526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.351808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.376276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] MFA Rules not processed for user `22459be27d334dde85abf32e9bc69cba`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:31.376835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] MFA Rules not processed for user `c0d9f3a32dec4f9a8d5d9e47c8b0a960`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:31.377527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:31.378071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:31.440710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 985/1998] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:31.441234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1014/1999] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:31.447036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.456798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.458928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:31.520790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23940011-78d7-4cfc-9e32-93ee6c015c49 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.526110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecfb08-29bf-4d4f-9f90-7e2e6e06173f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.528337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.529004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.529320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.529548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.529894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.530264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.530535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.530909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.531786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.532349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.568769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.570879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.590676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1015/2000] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:31.593078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 986/2001] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:31.595734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.611182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e003-36fd-4e88-b439-e3b727dc8c75 service glance] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.691160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.692083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.710287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.710287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.710287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.710287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.738945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1016/2002] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:31 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:31.743138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.757133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81280a92-896f-4aac-b1d9-b51e70edcedf admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.762018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.762704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.762988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.763259 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.763977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.765582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.776882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 987/2003] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:31.780895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.791039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36fbf-c3ac-46d1-b2e0-32367bb8923d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.796164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.797037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.797319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.797617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] PATH_INFO: `/v3/projects/018efe3677d246c58e34e09aa8563b33/users/c93d585c4046479cbc06c615635494ea/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.812721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018efe3677d246c58e34e09aa8563b33, user_id=c93d585c4046479cbc06c615635494ea, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.815397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.830113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1017/2004] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:31 2022] PUT /identity/v3/projects/018efe3677d246c58e34e09aa8563b33/users/c93d585c4046479cbc06c615635494ea/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:31.833994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.844361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6e8c-60bb-4765-9132-c774faed554f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.904033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46154f8-94c7-45e5-8e36-b041e87c6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.904700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46154f8-94c7-45e5-8e36-b041e87c6977 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.904979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46154f8-94c7-45e5-8e36-b041e87c6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.905290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46154f8-94c7-45e5-8e36-b041e87c6977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.906068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46154f8-94c7-45e5-8e36-b041e87c6977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.907647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46154f8-94c7-45e5-8e36-b041e87c6977 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:31.917271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 988/2005] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:31.922084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:31.951466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f0259-aeb6-43bb-8074-51f9b37c93c5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:31.958350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:31.959277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:31.959561 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:31.959884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] PATH_INFO: `/v3/projects/018efe3677d246c58e34e09aa8563b33/users/c93d585c4046479cbc06c615635494ea/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:31.963391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=018efe3677d246c58e34e09aa8563b33, user_id=c93d585c4046479cbc06c615635494ea, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:31.969014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:32.006115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1018/2006] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:31 2022] PUT /identity/v3/projects/018efe3677d246c58e34e09aa8563b33/users/c93d585c4046479cbc06c615635494ea/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:32.018243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:32.018728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:32.019012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:32.054150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] MFA Rules not processed for user `c93d585c4046479cbc06c615635494ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:32.055490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:32.255389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 989/2007] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:32.267510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:32.269406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:32.399306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe482309-8dd9-47cd-82e6-139f1d57c4ef admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:32.404032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e77935-d82d-4a90-ad5f-9f791846bb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:32.404808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e77935-d82d-4a90-ad5f-9f791846bb25 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:32.405216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e77935-d82d-4a90-ad5f-9f791846bb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:32.405621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e77935-d82d-4a90-ad5f-9f791846bb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:32.416322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e77935-d82d-4a90-ad5f-9f791846bb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:32.417949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e77935-d82d-4a90-ad5f-9f791846bb25 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:32.435962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1019/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:32.468202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:32.571907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71cfaa-dae6-4954-a8db-d3a20d48c04b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:32.577013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:32.577978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:32.582016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:32.582373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] PATH_INFO: `/v3/users/c0d9f3a32dec4f9a8d5d9e47c8b0a960` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:32.584522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d9f3a32dec4f9a8d5d9e47c8b0a960)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:32.586653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:32.640200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d9f3a32dec4f9a8d5d9e47c8b0a960'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:32.652366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d9f3a32dec4f9a8d5d9e47c8b0a960'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:32.653819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d9f3a32dec4f9a8d5d9e47c8b0a960'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:32.663110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d9f3a32dec4f9a8d5d9e47c8b0a960'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:32.671624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d9f3a32dec4f9a8d5d9e47c8b0a960'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:32.679317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 990/2009] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:32 2022] DELETE /identity/v3/users/c0d9f3a32dec4f9a8d5d9e47c8b0a960 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:32.684307 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:32.685699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:32.686203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:32.708535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:32.711266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:32.820027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1020/2010] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:32.836920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:32.838403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:32.913643 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea040-9b16-4f61-ae7a-6dfc060ecf89 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:32.917656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:32.918360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:32.918780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:32.919066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:32.928911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:32.930566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:32.940832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 991/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:33.257082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:33.258500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:33.276883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aefe8d-2a5e-43c7-a0cd-9c8d8ba61cf2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:33.284320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:33.285259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:33.285622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:33.285907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] PATH_INFO: `/v3/projects/96ecf26c0a7542a688ff41fbb7d3e196` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:33.287383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ecf26c0a7542a688ff41fbb7d3e196)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:33.289263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:33.338654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ecf26c0a7542a688ff41fbb7d3e196', 'request_id': 'req-32fa7c4a-6c30-492f-aed6-7daaaa37707b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.347414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ecf26c0a7542a688ff41fbb7d3e196', 'request_id': 'req-32fa7c4a-6c30-492f-aed6-7daaaa37707b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.354184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ecf26c0a7542a688ff41fbb7d3e196', 'request_id': 'req-32fa7c4a-6c30-492f-aed6-7daaaa37707b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.371733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] The token cache is being invalidate because project 96ecf26c0a7542a688ff41fbb7d3e196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:33.372100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.373028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.375004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1021/2012] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:33 2022] DELETE /identity/v3/projects/96ecf26c0a7542a688ff41fbb7d3e196 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:33.379593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:33.391231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059df8f-3d74-4388-8944-490fbd4efe13 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:33.445139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:33.446050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:33.446339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:33.446618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] PATH_INFO: `/v3/users/c93d585c4046479cbc06c615635494ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:33.447816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93d585c4046479cbc06c615635494ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:33.450338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:33.496199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93d585c4046479cbc06c615635494ea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.508639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93d585c4046479cbc06c615635494ea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.509310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93d585c4046479cbc06c615635494ea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.516502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93d585c4046479cbc06c615635494ea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.527005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c445b099-9112-46e8-8339-bbec71be792c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93d585c4046479cbc06c615635494ea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:33.538144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 992/2013] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:33 2022] DELETE /identity/v3/users/c93d585c4046479cbc06c615635494ea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:33.842243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:33.844367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:33.896168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7c4a-6c30-492f-aed6-7daaaa37707b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:33.999255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.000314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.000731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.001010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] PATH_INFO: `/v3/projects/018efe3677d246c58e34e09aa8563b33` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.002984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=018efe3677d246c58e34e09aa8563b33)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.004871 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.076785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018efe3677d246c58e34e09aa8563b33', 'request_id': 'req-94baa043-cb20-4240-8f4c-e266cedbae2c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:34.086824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018efe3677d246c58e34e09aa8563b33', 'request_id': 'req-94baa043-cb20-4240-8f4c-e266cedbae2c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:34.093753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018efe3677d246c58e34e09aa8563b33', 'request_id': 'req-94baa043-cb20-4240-8f4c-e266cedbae2c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:34.104276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] The token cache is being invalidate because project 018efe3677d246c58e34e09aa8563b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:34.104567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:34.106323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-94baa043-cb20-4240-8f4c-e266cedbae2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:34.109289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1022/2014] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:33 2022] DELETE /identity/v3/projects/018efe3677d246c58e34e09aa8563b33 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:34.115233 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.115648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.116002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.149608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:34.151312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:34.222808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 993/2015] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:34.230232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.230518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.231436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.249609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:34.250774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:34.258962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1023/2016] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:34.263234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.272926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67429b-10a2-44a4-8e70-7e60c32f5f71 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.278322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.278982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.279283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.279560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.280310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:34.280653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.282250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.295631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 994/2017] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:34.299468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.308652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bb50-e01c-41f8-a823-f7c9ac695e74 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.316034 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.316813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.317024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.317250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.318159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.320068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.363166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1024/2018] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:34.367205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.377318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7e996-94a1-4a4f-ab47-2ef901a36663 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.448564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.449282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.449623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.449951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.450651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.452536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.471666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 995/2019] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:34.475539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.486727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07129a86-2eae-413e-982b-23eec866c934 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.491573 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.492301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.492584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.492861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.493616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.495201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.505402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1025/2020] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:34.509215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.518850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af704c-6a25-47a4-a244-fd17ed13e169 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.523312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff6d36-4676-4b3e-b805-0a48696b6f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.523960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6d36-4676-4b3e-b805-0a48696b6f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.524237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6d36-4676-4b3e-b805-0a48696b6f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.524506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6d36-4676-4b3e-b805-0a48696b6f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.525218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff6d36-4676-4b3e-b805-0a48696b6f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.526827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff6d36-4676-4b3e-b805-0a48696b6f80 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.536981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 996/2021] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:34.540731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.550843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9405c4-139b-4e89-b115-03c228c250f6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.555293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.556145 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.556423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.556693 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] PATH_INFO: `/v3/projects/7aa2fb2ca7df4ae5862515bc081e59f0/users/fba5313309684bd3ab236fb9d286d8ee/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.570396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa2fb2ca7df4ae5862515bc081e59f0, user_id=fba5313309684bd3ab236fb9d286d8ee, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.573019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.585759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1026/2022] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:34 2022] PUT /identity/v3/projects/7aa2fb2ca7df4ae5862515bc081e59f0/users/fba5313309684bd3ab236fb9d286d8ee/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:34.597879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.598178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.598453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.624719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] MFA Rules not processed for user `fba5313309684bd3ab236fb9d286d8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:34.625981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:34.693249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 997/2023] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:34.697840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.758509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489a115-035a-419c-ab53-b00a9dfd9fcb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.763808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.764454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.764761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.765033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.765759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.767969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.792462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1027/2024] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:34.796436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.807179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb316a-384d-4957-8593-4bea8a4831c6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.867376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.868279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.868687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.868963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.870158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.873996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.900840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 998/2025] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:34 2022] POST /identity/v3/users => generated 306 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:34.905655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.915903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e358d-0121-4be8-b8b6-ffb6a101bf82 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.922422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.923072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.923355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.923635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.924372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.926058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.936512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1028/2026] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:34.940900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:34.951351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f13ca-6ca8-4ff3-a87b-d2962d5208cc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:34.956557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:34.957438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:34.957757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:34.958038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] PATH_INFO: `/v3/projects/25b132bcd817422886569eccc13100f2/users/229a68f320a24daa9d18c46543f8fc22/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:34.973467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b132bcd817422886569eccc13100f2, user_id=229a68f320a24daa9d18c46543f8fc22, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:34.976278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:34.990062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 999/2027] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:34 2022] PUT /identity/v3/projects/25b132bcd817422886569eccc13100f2/users/229a68f320a24daa9d18c46543f8fc22/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:34.993911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.004578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ae1-13e1-497f-86e9-237ade592b7b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.064750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.065339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.065652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.065947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.066650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.068272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.078863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1029/2028] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:35.084130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.097979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a310-1469-4ce6-a8bd-66123438d2a5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.101086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648844-bb1a-4a92-ae3e-ba9d64a4029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.101470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648844-bb1a-4a92-ae3e-ba9d64a4029e admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.101962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648844-bb1a-4a92-ae3e-ba9d64a4029e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.102425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648844-bb1a-4a92-ae3e-ba9d64a4029e admin admin] PATH_INFO: `/v3/projects/25b132bcd817422886569eccc13100f2/users/229a68f320a24daa9d18c46543f8fc22/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.104705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648844-bb1a-4a92-ae3e-ba9d64a4029e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b132bcd817422886569eccc13100f2, user_id=229a68f320a24daa9d18c46543f8fc22, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.109630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648844-bb1a-4a92-ae3e-ba9d64a4029e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.119687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.122130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.124059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1000/2029] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:35 2022] PUT /identity/v3/projects/25b132bcd817422886569eccc13100f2/users/229a68f320a24daa9d18c46543f8fc22/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:35.134853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.135137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.135418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.147515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ca7e8-cfd9-4f82-b41a-46c1ff4ce6b3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.166485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] MFA Rules not processed for user `229a68f320a24daa9d18c46543f8fc22`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:35.168252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.214461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.215375 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.215654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.215931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] PATH_INFO: `/v3/users/9b3e34e4f86b4acbbd89a93c3aa384e6` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.217248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3e34e4f86b4acbbd89a93c3aa384e6)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.219188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.252718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1001/2030] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:35.264984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.267196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.278381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3e34e4f86b4acbbd89a93c3aa384e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.296055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3e34e4f86b4acbbd89a93c3aa384e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.304535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3e34e4f86b4acbbd89a93c3aa384e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.305192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3e34e4f86b4acbbd89a93c3aa384e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.312482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70975f94-41a1-427c-867e-5de47fb66028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3e34e4f86b4acbbd89a93c3aa384e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.318579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1030/2031] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:35 2022] DELETE /identity/v3/users/9b3e34e4f86b4acbbd89a93c3aa384e6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:35.322742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.323027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.323296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.331675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e352-ac37-4b04-a3a7-f3f31b663164 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.340504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:35.341358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.388977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.390539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.391170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.391923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.394596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.410357 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1031/2032] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:35.422786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.424737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.490964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.492396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.499917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b786f-bdca-4656-b108-a4fdde3a8364 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.503371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1002/2033] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:35.505104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.505857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.506204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.506547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.517128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.518792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.533540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1032/2034] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:35.596226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.598606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.612614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452641b-c3ed-4fa3-a747-f528f7fa691b service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.617737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.618924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.619387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.619816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.622590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.706316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.708269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.721754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1003/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:35.839391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.841621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:35.861195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486013e-3ab6-4fdb-abd6-2c62b4fc66cd service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:35.868316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:35.869622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:35.869981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:35.870342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] PATH_INFO: `/v3/projects/f38d2d8f8ff747b09236f39361d09569` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:35.871503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38d2d8f8ff747b09236f39361d09569)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:35.873548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:35.927646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38d2d8f8ff747b09236f39361d09569', 'request_id': 'req-3a4a3896-6635-43fb-9151-3691b6f001f4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.940394 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38d2d8f8ff747b09236f39361d09569', 'request_id': 'req-3a4a3896-6635-43fb-9151-3691b6f001f4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.949922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38d2d8f8ff747b09236f39361d09569', 'request_id': 'req-3a4a3896-6635-43fb-9151-3691b6f001f4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.965720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] The token cache is being invalidate because project f38d2d8f8ff747b09236f39361d09569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:35.966311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.967199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:35.969155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1033/2036] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:35 2022] DELETE /identity/v3/projects/f38d2d8f8ff747b09236f39361d09569 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:35.973364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:35.986112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a3a0-2419-47c3-b2aa-795fcfb871c8 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:36.057123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:36.058049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.058331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.058609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] PATH_INFO: `/v3/users/dd48fa888c784d848d328cfb2b1f626c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.059858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd48fa888c784d848d328cfb2b1f626c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:36.061821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:36.113150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd48fa888c784d848d328cfb2b1f626c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.124698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd48fa888c784d848d328cfb2b1f626c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.125438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd48fa888c784d848d328cfb2b1f626c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.132348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd48fa888c784d848d328cfb2b1f626c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.139702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-901855ab-2868-4a02-80f2-bbc5e0fcb7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd48fa888c784d848d328cfb2b1f626c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.145854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1004/2037] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:35 2022] DELETE /identity/v3/users/dd48fa888c784d848d328cfb2b1f626c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:36.489925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:36.491363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:36.517851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a3896-6635-43fb-9151-3691b6f001f4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:36.575706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:36.576322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.576604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.576878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] PATH_INFO: `/v3/projects/5bb58b5b31ff4c388200a9be423771fe` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.578097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb58b5b31ff4c388200a9be423771fe)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:36.580023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:36.625834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb58b5b31ff4c388200a9be423771fe', 'request_id': 'req-67358620-7ffb-4474-99ea-82f4fa8dd603'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.635979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb58b5b31ff4c388200a9be423771fe', 'request_id': 'req-67358620-7ffb-4474-99ea-82f4fa8dd603'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.643959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb58b5b31ff4c388200a9be423771fe', 'request_id': 'req-67358620-7ffb-4474-99ea-82f4fa8dd603'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.654586 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] The token cache is being invalidate because project 5bb58b5b31ff4c388200a9be423771fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:36.654835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.655452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-67358620-7ffb-4474-99ea-82f4fa8dd603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:36.657006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1034/2038] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:36 2022] DELETE /identity/v3/projects/5bb58b5b31ff4c388200a9be423771fe => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:36.662151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.662640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.662747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.680284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:36.681485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:36.742862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1005/2039] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:36.750995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.751286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.751566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.769704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:36.770887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:36.778670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1035/2040] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:36.782860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:36.792151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d38a4-554c-4d5d-b1f7-310ebabb5181 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:36.796834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:36.797490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.797801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.798074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.798796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:36.799211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:36.800992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:36.814462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1006/2041] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:36.819367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:36.830221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e68f-b77d-4de3-bcdf-35d2d764c5e7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:36.834913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:36.835572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.835855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.836129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.836818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:36.838753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:36.863982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1036/2042] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:36 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:36.868271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:36.878677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedbe59-0ba1-4d07-b864-c13cdc80024d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:36.932555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:36.933146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.933430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.934331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.935025 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:36.936943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:36.955724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1007/2043] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:36 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:36.959941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:36.970336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0f47-5eda-42fd-a2a7-7a9c282560df admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:36.974938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:36.975590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:36.975874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:36.976152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:36.976875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:36.978503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:36.989003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1037/2044] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:36.992756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.002934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e890fb-76fb-4fbc-bad2-25f92d6991e1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.007388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f8a5-18f4-42af-905b-bd1937bdfacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.008029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f8a5-18f4-42af-905b-bd1937bdfacf admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.008306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f8a5-18f4-42af-905b-bd1937bdfacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.008573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f8a5-18f4-42af-905b-bd1937bdfacf admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.009277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f8a5-18f4-42af-905b-bd1937bdfacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.010887 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f8a5-18f4-42af-905b-bd1937bdfacf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.020336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1008/2045] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:37.024206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.034147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49da11f-9b9a-4e1a-8c3f-bf4c14b2677d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.038754 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.039608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.039883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.040154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] PATH_INFO: `/v3/projects/c8edd47e94fc475d9a4250bc3cf0d513/users/1b72f3db2ec746928169cff3bb7fda0e/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.054532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8edd47e94fc475d9a4250bc3cf0d513, user_id=1b72f3db2ec746928169cff3bb7fda0e, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.057167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.069985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1038/2046] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:37 2022] PUT /identity/v3/projects/c8edd47e94fc475d9a4250bc3cf0d513/users/1b72f3db2ec746928169cff3bb7fda0e/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:37.082409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.082761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.083044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.129345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] MFA Rules not processed for user `1b72f3db2ec746928169cff3bb7fda0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:37.130579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:37.194153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1009/2047] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:37.198501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.259103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030abaa-ba63-49dc-8616-deea86c1d89d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.264149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.264846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.265123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.265439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.266212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.268121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.294397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1039/2048] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:37 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:37.298506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.310278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8581f-e4c6-4dab-a9a2-c0eb42cefef2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.371841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.372630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.372917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.373196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.373929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.375885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.401614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1010/2049] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:37 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:37.404030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.415152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894063-3c40-4e76-aaab-54b7ef1a19a5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.420802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.421682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.422049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.422332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.423068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.424691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.435691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1040/2050] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:37.440012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.449897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2b84-fbdd-4536-ae68-0f28ccce265d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.454481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.456312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.456588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.457218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] PATH_INFO: `/v3/projects/dceeb0616d1c41919256eb5f42036643/users/fb428381baf649ed86230d77f401f9ef/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.474263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dceeb0616d1c41919256eb5f42036643, user_id=fb428381baf649ed86230d77f401f9ef, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.476898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.495281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1011/2051] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:37 2022] PUT /identity/v3/projects/dceeb0616d1c41919256eb5f42036643/users/fb428381baf649ed86230d77f401f9ef/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:37.499166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.510087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca17ee-cce2-494c-ba1e-af89afa6fec7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.581817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d781a-ce85-407f-b630-2375f1c9c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.582704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d781a-ce85-407f-b630-2375f1c9c5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.583202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d781a-ce85-407f-b630-2375f1c9c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.583482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d781a-ce85-407f-b630-2375f1c9c5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.584216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d781a-ce85-407f-b630-2375f1c9c5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.585890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d781a-ce85-407f-b630-2375f1c9c5d2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.600724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1041/2052] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:37.602017 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.624083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94b6d-4aa3-4f8c-9552-9a5b6c5ec6d7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.630001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.630984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.631354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.631696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] PATH_INFO: `/v3/projects/dceeb0616d1c41919256eb5f42036643/users/fb428381baf649ed86230d77f401f9ef/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.633867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dceeb0616d1c41919256eb5f42036643, user_id=fb428381baf649ed86230d77f401f9ef, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.637283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.650334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1012/2053] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:37 2022] PUT /identity/v3/projects/dceeb0616d1c41919256eb5f42036643/users/fb428381baf649ed86230d77f401f9ef/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:37.661258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.661959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.662865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.701265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] MFA Rules not processed for user `fb428381baf649ed86230d77f401f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:37.702768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:37.801791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1042/2054] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:37.812739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.814585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:37.874420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354d61a-1833-4c8d-85b7-b3e74f3c26fc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.878179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.878852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.879134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.879406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:37.888978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:37.890443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:37.901704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1013/2055] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:37 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:37.976366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:37.985899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db13245-6845-481b-bfbc-c9860be7232e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:37.989412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a605a7-0a27-4cec-955c-45f29151798e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:37.990071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a605a7-0a27-4cec-955c-45f29151798e service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:37.990346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a605a7-0a27-4cec-955c-45f29151798e service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:37.990616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a605a7-0a27-4cec-955c-45f29151798e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:38.054564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a605a7-0a27-4cec-955c-45f29151798e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:38.056007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a605a7-0a27-4cec-955c-45f29151798e service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:38.065588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1043/2056] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:39.884084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:39.885488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:39.952105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad52461-53e9-450a-a60c-0b5c7146b62d service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:39.956836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:39.957732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:39.958010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:39.958278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] PATH_INFO: `/v3/users/fba5313309684bd3ab236fb9d286d8ee` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:39.959443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba5313309684bd3ab236fb9d286d8ee)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:39.961350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:40.010249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba5313309684bd3ab236fb9d286d8ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.022329 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba5313309684bd3ab236fb9d286d8ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.023026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba5313309684bd3ab236fb9d286d8ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.029895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba5313309684bd3ab236fb9d286d8ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.038258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba5313309684bd3ab236fb9d286d8ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.045825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1014/2057] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:39 2022] DELETE /identity/v3/users/fba5313309684bd3ab236fb9d286d8ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:40.051820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:40.052500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:40.053192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:40.075079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:40.075964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:40.134341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1044/2058] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:40.143510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:40.144957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:40.202623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071f91a-f1ff-4031-b594-b51e26cb4226 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:40.206373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:40.207022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:40.207306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:40.207580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:40.216748 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:40.218220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:40.228473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1015/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:40.579273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:40.580679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:40.592527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5502b2-9f90-487e-a4c5-ab20ce657578 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:40.597392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:40.598287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:40.598999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:40.599452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] PATH_INFO: `/v3/projects/7aa2fb2ca7df4ae5862515bc081e59f0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:40.600875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa2fb2ca7df4ae5862515bc081e59f0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:40.603171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:40.651966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa2fb2ca7df4ae5862515bc081e59f0', 'request_id': 'req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.662408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa2fb2ca7df4ae5862515bc081e59f0', 'request_id': 'req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.670277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa2fb2ca7df4ae5862515bc081e59f0', 'request_id': 'req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.682058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] The token cache is being invalidate because project 7aa2fb2ca7df4ae5862515bc081e59f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:40.682387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.683192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.684890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1045/2060] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:40 2022] DELETE /identity/v3/projects/7aa2fb2ca7df4ae5862515bc081e59f0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:40.688867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:40.701534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e4430-ed59-437d-adde-930f92cda843 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:40.791092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:40.792067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:40.792484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:40.792809 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] PATH_INFO: `/v3/users/229a68f320a24daa9d18c46543f8fc22` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:40.795859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=229a68f320a24daa9d18c46543f8fc22)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:40.798016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:40.841338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:40.841338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:40.854565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c003d2-d658-4c5b-83ae-5b0cb16f45bf admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:40.860064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:40.861594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:40.861916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:40.862313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] PATH_INFO: `/v3/users/1b72f3db2ec746928169cff3bb7fda0e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:40.863691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b72f3db2ec746928169cff3bb7fda0e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:40.865504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:40.867355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229a68f320a24daa9d18c46543f8fc22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.880918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229a68f320a24daa9d18c46543f8fc22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.881701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229a68f320a24daa9d18c46543f8fc22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.891499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229a68f320a24daa9d18c46543f8fc22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.899282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8801286e-5ae2-4c9e-ab8a-352b79384e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229a68f320a24daa9d18c46543f8fc22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.906547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1016/2061] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:40 2022] DELETE /identity/v3/users/229a68f320a24daa9d18c46543f8fc22 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:40.919562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b72f3db2ec746928169cff3bb7fda0e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.931873 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b72f3db2ec746928169cff3bb7fda0e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.939272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b72f3db2ec746928169cff3bb7fda0e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.939928 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b72f3db2ec746928169cff3bb7fda0e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.947083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b72f3db2ec746928169cff3bb7fda0e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:40.953356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1046/2062] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:40 2022] DELETE /identity/v3/users/1b72f3db2ec746928169cff3bb7fda0e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:40.957853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:40.958143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:40.958419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:40.976930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:40.978270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.040348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1017/2063] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:41.049717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.051198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.134947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15fef-0f5e-4377-835c-a90183e05917 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.140037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23701d6e-8dbd-4d2a-af76-ec51252855ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.140771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23701d6e-8dbd-4d2a-af76-ec51252855ea service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.141178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23701d6e-8dbd-4d2a-af76-ec51252855ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.141778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23701d6e-8dbd-4d2a-af76-ec51252855ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.156637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23701d6e-8dbd-4d2a-af76-ec51252855ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.158287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23701d6e-8dbd-4d2a-af76-ec51252855ea service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.168176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1047/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:41.221803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.223835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.240279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ef93a-b257-4582-9d18-8a3cf08ea4e6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.255763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.256150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.256349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.257125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] PATH_INFO: `/v3/projects/25b132bcd817422886569eccc13100f2` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.258042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b132bcd817422886569eccc13100f2)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.260013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.311313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b132bcd817422886569eccc13100f2', 'request_id': 'req-00ef3d1e-48cf-4662-ad6d-49cf946585ae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.318862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b132bcd817422886569eccc13100f2', 'request_id': 'req-00ef3d1e-48cf-4662-ad6d-49cf946585ae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.326540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b132bcd817422886569eccc13100f2', 'request_id': 'req-00ef3d1e-48cf-4662-ad6d-49cf946585ae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.336873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] The token cache is being invalidate because project 25b132bcd817422886569eccc13100f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:41.337159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.337856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-00ef3d1e-48cf-4662-ad6d-49cf946585ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.339733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1018/2065] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:41 2022] DELETE /identity/v3/projects/25b132bcd817422886569eccc13100f2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:41.344919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.345250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.345631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.362662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:41.363938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.426359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1048/2066] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:41.434670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.434957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.435243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.453445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:41.454923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.465852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1019/2067] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:41.470519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.481999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc50dc-10b5-4df1-aea5-3eb09a38c76c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.488155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.488831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.489111 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.489405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.490193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:41.490722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.492344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.508536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1049/2068] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:41.508691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.509363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.510134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.522724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d2824-bd52-417a-a603-8386d0941611 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.523201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4debf9b-01d4-45bc-8d8d-2e118234dbd2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.528134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.528653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.528783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.529060 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.529368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.530106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.530218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.530567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.530844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] PATH_INFO: `/v3/projects/c8edd47e94fc475d9a4250bc3cf0d513` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.532086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8edd47e94fc475d9a4250bc3cf0d513)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.532201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.534298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.558245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1050/2069] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:41 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:41.563133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.582283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8edd47e94fc475d9a4250bc3cf0d513', 'request_id': 'req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.590426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8edd47e94fc475d9a4250bc3cf0d513', 'request_id': 'req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.597968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8edd47e94fc475d9a4250bc3cf0d513', 'request_id': 'req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.607862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] The token cache is being invalidate because project c8edd47e94fc475d9a4250bc3cf0d513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:41.608146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.608820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.610416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1020/2070] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:41 2022] DELETE /identity/v3/projects/c8edd47e94fc475d9a4250bc3cf0d513 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:41.614172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.615521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.624073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa4002-e2d2-4adc-847e-68cca58d9ba9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.677029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ad0b-e7e2-4533-84ff-580a0d5e2ed0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.677224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.677762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.678044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.678317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.678996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.680909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.681689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.682556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.682837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.683112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] PATH_INFO: `/v3/users/fb428381baf649ed86230d77f401f9ef` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.684861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb428381baf649ed86230d77f401f9ef)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.686954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.711360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1051/2071] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:41 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:41.712582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.714570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.726151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427b053-2da0-4a94-ada9-4c1697f6aefe admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.731308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.732187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.732470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.733587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.734430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.736930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.738314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb428381baf649ed86230d77f401f9ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.749351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1052/2072] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:41.750905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb428381baf649ed86230d77f401f9ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.751630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb428381baf649ed86230d77f401f9ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.758353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb428381baf649ed86230d77f401f9ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.761416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.766492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb428381baf649ed86230d77f401f9ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:41.772567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bd0c-e989-4ee1-b2b6-6b7c34aed5ad admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.772911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1021/2073] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:41 2022] DELETE /identity/v3/users/fb428381baf649ed86230d77f401f9ef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:41.840343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c65b6-749f-4d8e-bf25-cf2461f4984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.841019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c65b6-749f-4d8e-bf25-cf2461f4984c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.841304 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c65b6-749f-4d8e-bf25-cf2461f4984c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.841606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c65b6-749f-4d8e-bf25-cf2461f4984c admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.842340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c65b6-749f-4d8e-bf25-cf2461f4984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.843940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c65b6-749f-4d8e-bf25-cf2461f4984c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.854360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1053/2074] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:41.859346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:41.860867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:41.876118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7863082-00c5-4f56-9694-e2062c35751d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:41.883098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:41.884386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.884386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.884590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] PATH_INFO: `/v3/projects/ec758a879ca044baac8015108421eee3/users/432c8ae3cded48b88340ebe9fd26789b/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.904196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec758a879ca044baac8015108421eee3, user_id=432c8ae3cded48b88340ebe9fd26789b, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:41.904870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:41.929723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1022/2075] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:41 2022] PUT /identity/v3/projects/ec758a879ca044baac8015108421eee3/users/432c8ae3cded48b88340ebe9fd26789b/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:41.938162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:41.938451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:41.938932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:41.988383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] MFA Rules not processed for user `432c8ae3cded48b88340ebe9fd26789b`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:41.989820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.090045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1054/2076] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:42.094452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.127349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.129305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.188795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4517b-1d70-41bd-b94d-d61eae3cd759 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.194330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.195108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.195582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.195936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.196711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.199223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.226067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0f884-1a39-463b-afd0-3026ceac1c4d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.232512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.233474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.233921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.234235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] PATH_INFO: `/v3/projects/dceeb0616d1c41919256eb5f42036643` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.236940 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dceeb0616d1c41919256eb5f42036643)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.239100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.244117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1023/2077] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:42.248177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.325867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dceeb0616d1c41919256eb5f42036643', 'request_id': 'req-43bed33a-8ccb-4e32-bb20-1ab069a10507'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:42.334675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dceeb0616d1c41919256eb5f42036643', 'request_id': 'req-43bed33a-8ccb-4e32-bb20-1ab069a10507'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:42.343334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dceeb0616d1c41919256eb5f42036643', 'request_id': 'req-43bed33a-8ccb-4e32-bb20-1ab069a10507'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:42.349954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29baa-05e1-4bdb-add5-2669ebcb9b26 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.354647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] The token cache is being invalidate because project dceeb0616d1c41919256eb5f42036643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:42.354937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:42.355601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-43bed33a-8ccb-4e32-bb20-1ab069a10507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:42.358447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1055/2078] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:42 2022] DELETE /identity/v3/projects/dceeb0616d1c41919256eb5f42036643 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:42.362820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.363178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.363530 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.381817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:42.383033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.412687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517b023-e644-4ec8-9ae0-1f1e2f8fceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.413372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517b023-e644-4ec8-9ae0-1f1e2f8fceda admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.413683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517b023-e644-4ec8-9ae0-1f1e2f8fceda admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.413969 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517b023-e644-4ec8-9ae0-1f1e2f8fceda admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.414732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517b023-e644-4ec8-9ae0-1f1e2f8fceda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.416646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517b023-e644-4ec8-9ae0-1f1e2f8fceda admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.444749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1056/2079] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:42.448551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1024/2080] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:42.450793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.452626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.452990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.453349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.453729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.464383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493024-7e1d-4dba-830e-a24de98292e1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.470132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.470795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.471073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.471346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.472418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.474043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.475480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:42.476763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.485153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1057/2081] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:42.489364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.490434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1025/2082] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:42.494338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.499936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c74c-1650-4233-a331-912d0a3dca58 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.503867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c801-d8a0-4f4c-8e7f-d0f1e6e71292 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.505101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.506192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.506433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.506725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] PATH_INFO: `/v3/projects/051348b8853a4717a36d284fffd79a58/users/d8b1e4c548d74adea908f8fb62a32eb1/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.510038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.511027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.511468 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.511903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.513409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:42.513895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.515673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.522355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051348b8853a4717a36d284fffd79a58, user_id=d8b1e4c548d74adea908f8fb62a32eb1, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.526337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.528687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1026/2083] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:42.533248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.544485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b94da-78e6-42ee-ac0a-4771578a3fdc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.553602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1058/2084] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:42 2022] PUT /identity/v3/projects/051348b8853a4717a36d284fffd79a58/users/d8b1e4c548d74adea908f8fb62a32eb1/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:42.556019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.636385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e08d-c190-4000-b085-7c03b3c716c3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.641639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.642190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.642311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.642582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.642891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.643036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.643281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.643558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.643663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.644355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.645477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.645976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.657060 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1059/2085] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:42.661808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.673401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb1f0-552e-484c-80ed-783fa700c4d6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.678311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1027/2086] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:42.679346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.742721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7b62-9772-402e-ac87-9164553f03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.743691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7b62-9772-402e-ac87-9164553f03e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.744043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7b62-9772-402e-ac87-9164553f03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.744445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7b62-9772-402e-ac87-9164553f03e1 admin admin] PATH_INFO: `/v3/projects/051348b8853a4717a36d284fffd79a58/users/d8b1e4c548d74adea908f8fb62a32eb1/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.746863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d7b62-9772-402e-ac87-9164553f03e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051348b8853a4717a36d284fffd79a58, user_id=d8b1e4c548d74adea908f8fb62a32eb1, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.749543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d7b62-9772-402e-ac87-9164553f03e1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.756004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d66cf-2ba7-4c85-bd50-0d28aae7b1b7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.770722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1060/2087] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:42 2022] PUT /identity/v3/projects/051348b8853a4717a36d284fffd79a58/users/d8b1e4c548d74adea908f8fb62a32eb1/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:42.783807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.784104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.784391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.829783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] MFA Rules not processed for user `d8b1e4c548d74adea908f8fb62a32eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:42.829783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.838908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.839993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.840994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.841718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.842785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.844797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.867547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1028/2088] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:42.872926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.883830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121df9a-34d7-4641-8dca-f1bbc8943101 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.889213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.889843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.890126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.890398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.891114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.892686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.903186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1029/2089] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:42.907157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.912413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1061/2090] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:42.923046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.923175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829baaa-16f3-41b1-bf0a-f8d49c471ccc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.924380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:42.927830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.928487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.928767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.929049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.929796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.931382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.942225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1030/2091] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:42.946472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:42.956655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0ebf-fa56-4962-940a-6632fb972b50 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.961454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211853-f019-4c5b-89a8-51d28bb0bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.962438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211853-f019-4c5b-89a8-51d28bb0bee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.962722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211853-f019-4c5b-89a8-51d28bb0bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.963006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211853-f019-4c5b-89a8-51d28bb0bee0 admin admin] PATH_INFO: `/v3/projects/246354ae15e9449c86b661765b38e39e/users/02c5a3b96dbf443494ce8da5e1a7bce9/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:42.981123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211853-f019-4c5b-89a8-51d28bb0bee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246354ae15e9449c86b661765b38e39e, user_id=02c5a3b96dbf443494ce8da5e1a7bce9, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:42.984001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211853-f019-4c5b-89a8-51d28bb0bee0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:42.989108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531723e3-dfc1-4e9d-acbc-8e68d86ebdd1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:42.994717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:42.995413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:42.995794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:42.996115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.003576 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1031/2092] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:42 2022] PUT /identity/v3/projects/246354ae15e9449c86b661765b38e39e/users/02c5a3b96dbf443494ce8da5e1a7bce9/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:43.013173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.014818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.017090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.017610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.017960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.025660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1062/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:43.047218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] MFA Rules not processed for user `02c5a3b96dbf443494ce8da5e1a7bce9`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:43.048355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:43.129154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1032/2094] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:43.133488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.144967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce62105-cb6c-42e1-867c-dca395c09d60 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.207994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.208878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.209371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.209593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.210292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.212379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.253191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1063/2095] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:43 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:43.256282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.268350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad56b93-a3e1-404a-806f-cfbad7bd5450 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.362116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.362884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.363234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.364451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.364451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.366605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.393680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1033/2096] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:43 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:43.397480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.415165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a83b-0ef3-496d-9c22-c49a7071c3d3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.421683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.422464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.422620 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.422881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.423605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.425182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.439834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1064/2097] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:43.443666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.455338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee46789-bf63-4383-828b-d947b687a614 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.461114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.462146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.463000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.463000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] PATH_INFO: `/v3/projects/7c0ca41680c04a6096ebc08878658411/users/bbf9bd516089449c8ab0f1eb542c947a/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.483202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0ca41680c04a6096ebc08878658411, user_id=bbf9bd516089449c8ab0f1eb542c947a, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.494910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.509181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1034/2098] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:43 2022] PUT /identity/v3/projects/7c0ca41680c04a6096ebc08878658411/users/bbf9bd516089449c8ab0f1eb542c947a/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:43.513106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.523154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6bcf-17d6-4305-81e2-df895a7b06ec admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.581308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32189652-c39b-4645-8220-6f0e8e7c365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.582081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189652-c39b-4645-8220-6f0e8e7c365d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.582434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189652-c39b-4645-8220-6f0e8e7c365d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.582780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189652-c39b-4645-8220-6f0e8e7c365d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.583600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189652-c39b-4645-8220-6f0e8e7c365d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.585489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189652-c39b-4645-8220-6f0e8e7c365d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.598725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1065/2099] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:43.600140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.611110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f496d4-8f91-4a07-83b8-a0e99c1b41bb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.616415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.617713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.618168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.618624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] PATH_INFO: `/v3/projects/7c0ca41680c04a6096ebc08878658411/users/bbf9bd516089449c8ab0f1eb542c947a/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.620716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0ca41680c04a6096ebc08878658411, user_id=bbf9bd516089449c8ab0f1eb542c947a, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.623977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.637007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1035/2100] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:43 2022] PUT /identity/v3/projects/7c0ca41680c04a6096ebc08878658411/users/bbf9bd516089449c8ab0f1eb542c947a/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:43.647113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.647399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.647677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.659577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.675800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] MFA Rules not processed for user `bbf9bd516089449c8ab0f1eb542c947a`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:43.677019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:43.722146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d68c13-f73c-40a0-94fe-90d63ac27eee admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.726823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.727703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.727989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.728260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] PATH_INFO: `/v3/users/432c8ae3cded48b88340ebe9fd26789b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.729448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432c8ae3cded48b88340ebe9fd26789b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.732003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.745233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1066/2101] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:43.757406 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.758907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:43.778560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432c8ae3cded48b88340ebe9fd26789b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:43.790052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432c8ae3cded48b88340ebe9fd26789b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:43.790751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432c8ae3cded48b88340ebe9fd26789b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:43.797473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432c8ae3cded48b88340ebe9fd26789b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:43.805146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a6892166-af51-4e5e-a061-6f2b296a36b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432c8ae3cded48b88340ebe9fd26789b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:43.811787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1036/2102] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:43 2022] DELETE /identity/v3/users/432c8ae3cded48b88340ebe9fd26789b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:43.814746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b766-5cae-4e59-b88d-7c2afb179ac0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.816080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.816371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.816649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.833174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:43.834400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:43.865000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.865831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.866185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.866536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.868473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:43.895482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1037/2103] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:43.905825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:43.907327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:43.952802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.954284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.963872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1067/2104] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:43.971003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655036-08dd-41a3-b78e-acca926d49f7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:43.974793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:43.975444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:43.975728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:43.976006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:43.985667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:43.987095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:43.996583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1038/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:44.274692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.275220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.275341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:44.292217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd721f-0d7a-41bd-af72-3ce33e5275aa service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:44.297192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:44.299297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:44.299694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:44.300151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] PATH_INFO: `/v3/projects/ec758a879ca044baac8015108421eee3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:44.301801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec758a879ca044baac8015108421eee3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:44.304426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:44.309362 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185eaa2-3211-4b0c-a23f-aac7b24b3340 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:44.315023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf9bd516089449c8ab0f1eb542c947a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c0ca41680c04a6096ebc08878658411', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:44.315714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:44.316013 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:44.316281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:44.317008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:44.317853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:44.319454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:44.331546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1039/2106] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:44.336192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.346436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51d90c-3237-40f8-b070-241579590936 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:44.354441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec758a879ca044baac8015108421eee3', 'request_id': 'req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.362762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec758a879ca044baac8015108421eee3', 'request_id': 'req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.369240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec758a879ca044baac8015108421eee3', 'request_id': 'req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.379905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] The token cache is being invalidate because project ec758a879ca044baac8015108421eee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:44.380186 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.380812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.382418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1068/2107] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:44 2022] DELETE /identity/v3/projects/ec758a879ca044baac8015108421eee3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:44.386181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.388126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:44.404684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf9bd516089449c8ab0f1eb542c947a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c0ca41680c04a6096ebc08878658411', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:44.405412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:44.405865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:44.406046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:44.406700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:44.408877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:44.438154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1040/2108] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:44 2022] POST /identity/v3/projects => generated 353 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:44.439298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.440871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:44.457351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730dd78-8622-4d4d-9a8f-e423f9fbdb75 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:44.501939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb466a-78f4-4ae4-8929-3021b1535838 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:44.508302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf9bd516089449c8ab0f1eb542c947a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c0ca41680c04a6096ebc08878658411', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:44.508979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:44.509262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:44.509646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:44.510462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:44.510774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:44.513146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:44.514281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:44.515099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:44.515507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:44.515787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] PATH_INFO: `/v3/users/d8b1e4c548d74adea908f8fb62a32eb1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:44.517021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b1e4c548d74adea908f8fb62a32eb1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:44.519202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:44.525119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1041/2109] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:44.575599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.590616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb49dc-4218-47e4-9fb3-0f9db42eebaf tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:44.601401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf9bd516089449c8ab0f1eb542c947a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c0ca41680c04a6096ebc08878658411', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:44.601853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b1e4c548d74adea908f8fb62a32eb1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.604546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:44.604735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:44.605128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] PATH_INFO: `/v3/projects/3a3db53438084b8cb709a09605c8632f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:44.610365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a3db53438084b8cb709a09605c8632f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:44.612394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:44.615147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b1e4c548d74adea908f8fb62a32eb1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.635514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b1e4c548d74adea908f8fb62a32eb1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.636552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b1e4c548d74adea908f8fb62a32eb1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.647005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b1e4c548d74adea908f8fb62a32eb1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.654618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1069/2110] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:44 2022] DELETE /identity/v3/users/d8b1e4c548d74adea908f8fb62a32eb1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:44.683138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3db53438084b8cb709a09605c8632f', 'request_id': 'req-f3db9865-711b-4a72-94d1-35743d9ecd85'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.697569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3db53438084b8cb709a09605c8632f', 'request_id': 'req-f3db9865-711b-4a72-94d1-35743d9ecd85'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.709206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3db53438084b8cb709a09605c8632f', 'request_id': 'req-f3db9865-711b-4a72-94d1-35743d9ecd85'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.723429 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] The token cache is being invalidate because project 3a3db53438084b8cb709a09605c8632f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:44.723775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.728378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:44.730786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1042/2111] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:44 2022] DELETE /identity/v3/projects/3a3db53438084b8cb709a09605c8632f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:44.957124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:44.958741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.000648 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.002242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.051656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7090e39-f776-4dd1-862e-4b4c651ca15b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.076368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db9865-711b-4a72-94d1-35743d9ecd85 tempest-VolumeQuotaClassesTest-1791635198 tempest-VolumeQuotaClassesTest-1791635198-project-admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.081928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.082812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.083094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.083367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] PATH_INFO: `/v3/projects/051348b8853a4717a36d284fffd79a58` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.084693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051348b8853a4717a36d284fffd79a58)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.087186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.114489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.115424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.115694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.115925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] PATH_INFO: `/v3/users/02c5a3b96dbf443494ce8da5e1a7bce9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.117205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c5a3b96dbf443494ce8da5e1a7bce9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.119274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.151521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051348b8853a4717a36d284fffd79a58', 'request_id': 'req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.159545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051348b8853a4717a36d284fffd79a58', 'request_id': 'req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.166497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051348b8853a4717a36d284fffd79a58', 'request_id': 'req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.177984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c5a3b96dbf443494ce8da5e1a7bce9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.180903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] The token cache is being invalidate because project 051348b8853a4717a36d284fffd79a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:45.181415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.182333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6cbc7dd-0f40-482f-9593-0f78c4160dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.184256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1043/2112] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:44 2022] DELETE /identity/v3/projects/051348b8853a4717a36d284fffd79a58 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:45.188761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea566e47-7e37-463c-8286-f4564b5f3e01 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.189059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea566e47-7e37-463c-8286-f4564b5f3e01 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.189342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea566e47-7e37-463c-8286-f4564b5f3e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.192945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c5a3b96dbf443494ce8da5e1a7bce9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.202726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c5a3b96dbf443494ce8da5e1a7bce9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.203498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c5a3b96dbf443494ce8da5e1a7bce9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.210333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ea566e47-7e37-463c-8286-f4564b5f3e01 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:45.211548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ea566e47-7e37-463c-8286-f4564b5f3e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.211661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-158dde55-396a-49f2-b331-dcbf86595e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c5a3b96dbf443494ce8da5e1a7bce9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.218560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1070/2113] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:44 2022] DELETE /identity/v3/users/02c5a3b96dbf443494ce8da5e1a7bce9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:45.222880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.223168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.223442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.242455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:45.243666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.273409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1044/2114] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:45.281053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.281307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.281623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.301157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:45.302513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.308486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1071/2115] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:45.314220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1045/2116] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:45.318435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.318563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.321005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.329690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5381d-5104-4b0a-be3f-c6e28f6eeb0e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.335289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.336289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.336577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.336856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.337601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:45.337913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.339523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.352869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1046/2117] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:45.357081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.366657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56e53-0e30-47bf-bd22-6949f5346df1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.373195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.374004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.374448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.374850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.376402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.378640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.382005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146798-96c5-4b83-ba5e-32e36b5b0306 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.386220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.386875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.387713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.387992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.400844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.404865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.420994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1072/2118] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:45.422228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1047/2119] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:45.426222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.436447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba147-5db0-4a78-9398-9404fe5a922d service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.493756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.494389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.494677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.494990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.496108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.501737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.534356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1073/2120] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:45.539182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.555035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a406e-2fa3-44a5-8e5b-ecd97a25df24 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.561987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.563953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.563953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.563953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.564228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.566133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.578938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1048/2121] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:45.582900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.593204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0edbec-2afe-4afb-a87a-91d99c4a1392 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.598268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fe7b-b75c-40fc-aa51-a605d6cc561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.599794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fe7b-b75c-40fc-aa51-a605d6cc561d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.600063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fe7b-b75c-40fc-aa51-a605d6cc561d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.600855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fe7b-b75c-40fc-aa51-a605d6cc561d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.601521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781fe7b-b75c-40fc-aa51-a605d6cc561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.603171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781fe7b-b75c-40fc-aa51-a605d6cc561d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.616626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1074/2122] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:45.622164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.635387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e2dc-b91d-48c4-b604-5c88fb4e4ad9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.649094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.650076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.650365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.650708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] PATH_INFO: `/v3/projects/0f2a5f9b612d47988447fe20a713f830/users/b200433709714c349c1077a61e6d3926/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.666595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a5f9b612d47988447fe20a713f830, user_id=b200433709714c349c1077a61e6d3926, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.670085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.685192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1049/2123] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:45 2022] PUT /identity/v3/projects/0f2a5f9b612d47988447fe20a713f830/users/b200433709714c349c1077a61e6d3926/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:45.696117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.696402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.696674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.727990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] MFA Rules not processed for user `b200433709714c349c1077a61e6d3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:45.731268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.764895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.766946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:45.858697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1075/2124] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:45.867274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.889110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4a2a7-8cdc-4e0c-8fb5-c324c64d8d68 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.893944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.894855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.895134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.895411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] PATH_INFO: `/v3/projects/246354ae15e9449c86b661765b38e39e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.896625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=246354ae15e9449c86b661765b38e39e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.898566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.934551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a784b63-b1a2-47d4-9e2a-9edb8a13a845 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:45.940223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:45.940882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:45.941166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:45.941443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:45.942423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:45.944460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:45.962610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246354ae15e9449c86b661765b38e39e', 'request_id': 'req-fe725151-3f67-4030-88a6-e9b1e68b182e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.973511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246354ae15e9449c86b661765b38e39e', 'request_id': 'req-fe725151-3f67-4030-88a6-e9b1e68b182e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.976440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1076/2125] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:45.980596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:45.983211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246354ae15e9449c86b661765b38e39e', 'request_id': 'req-fe725151-3f67-4030-88a6-e9b1e68b182e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.997862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] The token cache is being invalidate because project 246354ae15e9449c86b661765b38e39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:45.998156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:45.998903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.000846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1050/2126] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:45 2022] DELETE /identity/v3/projects/246354ae15e9449c86b661765b38e39e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:46.004943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.007119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.048620 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb240bc-02bb-4861-af07-24e221326326 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.052369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.053288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.053411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.053720 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.054415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.056438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.079757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1077/2127] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:45 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:46.083761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.085508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725151-3f67-4030-88a6-e9b1e68b182e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.085956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.094152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.095613 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.096223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.096642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] PATH_INFO: `/v3/users/bbf9bd516089449c8ab0f1eb542c947a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.098637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf9bd516089449c8ab0f1eb542c947a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.101322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.108403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4b98-ce84-4077-b82b-b3992d9631f7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.114701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.116094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.116094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.116248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.116917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.118617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.133088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1078/2128] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:46.134077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.146593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667596-3091-4ef5-9633-f5186e61688f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.151428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.153235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.153235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.153633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] PATH_INFO: `/v3/projects/a90627f28678471fa229bf47857860a5/users/ebbad073a8974247b9fcd8e3bef2855f/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.165610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf9bd516089449c8ab0f1eb542c947a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.170694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90627f28678471fa229bf47857860a5, user_id=ebbad073a8974247b9fcd8e3bef2855f, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.173355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.181681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf9bd516089449c8ab0f1eb542c947a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.182517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf9bd516089449c8ab0f1eb542c947a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.189127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1079/2129] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:46 2022] PUT /identity/v3/projects/a90627f28678471fa229bf47857860a5/users/ebbad073a8974247b9fcd8e3bef2855f/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:46.191402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf9bd516089449c8ab0f1eb542c947a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.192759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.198550 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf9bd516089449c8ab0f1eb542c947a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.204716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1051/2130] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:46 2022] DELETE /identity/v3/users/bbf9bd516089449c8ab0f1eb542c947a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:46.255440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9897a-54d1-407a-b9c6-f25fe6deae55 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.314433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5cf95-c381-4048-a538-7053ccaf0dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.315157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5cf95-c381-4048-a538-7053ccaf0dac admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.315391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5cf95-c381-4048-a538-7053ccaf0dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.315680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5cf95-c381-4048-a538-7053ccaf0dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.316396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5cf95-c381-4048-a538-7053ccaf0dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.318068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5cf95-c381-4048-a538-7053ccaf0dac admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.328666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1080/2131] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:46.332798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.334241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.348040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242a70-0859-407c-ae89-33b25fba5bfb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.352538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.353689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.353792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.354071 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] PATH_INFO: `/v3/projects/a90627f28678471fa229bf47857860a5/users/ebbad073a8974247b9fcd8e3bef2855f/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.356097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90627f28678471fa229bf47857860a5, user_id=ebbad073a8974247b9fcd8e3bef2855f, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.358905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.369387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1052/2132] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:46 2022] PUT /identity/v3/projects/a90627f28678471fa229bf47857860a5/users/ebbad073a8974247b9fcd8e3bef2855f/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:46.379533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.379820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.380101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.406886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] MFA Rules not processed for user `ebbad073a8974247b9fcd8e3bef2855f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:46.408372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.474673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.476494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.478942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1081/2133] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:46.490504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.492919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.552389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee44a-5490-4fb5-8129-cf7a00709cf1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.554092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493960a-4d26-4a43-9e15-4a5e493c526c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.555992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeb2d4-e41b-4c01-b560-ac044edfeada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.556678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeb2d4-e41b-4c01-b560-ac044edfeada service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.556993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeb2d4-e41b-4c01-b560-ac044edfeada service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.557272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeb2d4-e41b-4c01-b560-ac044edfeada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.558910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.559762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.560050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.560331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] PATH_INFO: `/v3/projects/7c0ca41680c04a6096ebc08878658411` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.561500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0ca41680c04a6096ebc08878658411)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.563489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.566861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eeb2d4-e41b-4c01-b560-ac044edfeada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.568286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eeb2d4-e41b-4c01-b560-ac044edfeada service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.578282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1082/2134] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:46.613687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0ca41680c04a6096ebc08878658411', 'request_id': 'req-3560d26f-7b14-4832-ab04-9732b547f1de'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.620912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0ca41680c04a6096ebc08878658411', 'request_id': 'req-3560d26f-7b14-4832-ab04-9732b547f1de'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.628023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0ca41680c04a6096ebc08878658411', 'request_id': 'req-3560d26f-7b14-4832-ab04-9732b547f1de'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.639717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] The token cache is being invalidate because project 7c0ca41680c04a6096ebc08878658411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:46.639996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.640897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:46.642521 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1053/2135] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:46 2022] DELETE /identity/v3/projects/7c0ca41680c04a6096ebc08878658411 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:46.647252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3121-0edf-45bb-97b7-81c2722ffa17 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.647568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3121-0edf-45bb-97b7-81c2722ffa17 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.647844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3121-0edf-45bb-97b7-81c2722ffa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.648478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.649925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.667028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-786f3121-0edf-45bb-97b7-81c2722ffa17 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:46.668303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-786f3121-0edf-45bb-97b7-81c2722ffa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.706207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d26f-7b14-4832-ab04-9732b547f1de admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.710297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.710937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.711215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.711486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.713252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.727184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1083/2136] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:46.734966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535cbb7-b669-4379-939d-750c531b06af None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.735257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535cbb7-b669-4379-939d-750c531b06af None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.735540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535cbb7-b669-4379-939d-750c531b06af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.753793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d535cbb7-b669-4379-939d-750c531b06af None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:46.754992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d535cbb7-b669-4379-939d-750c531b06af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.763410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1084/2137] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:46.767407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535cbb7-b669-4379-939d-750c531b06af None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.770635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.772073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.775813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535cbb7-b669-4379-939d-750c531b06af None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.780474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.781113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.781216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1054/2138] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:46.781399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.781708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.782685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:46.782985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.784551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.796050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1085/2139] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:46.804056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.815598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32398d-cae8-4aa7-9904-8c81f4178461 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.820668 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c61ee-401a-49db-bc2e-e70cd89e3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.821196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c61ee-401a-49db-bc2e-e70cd89e3943 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.821480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c61ee-401a-49db-bc2e-e70cd89e3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.821826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c61ee-401a-49db-bc2e-e70cd89e3943 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.822556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c61ee-401a-49db-bc2e-e70cd89e3943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.825074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c61ee-401a-49db-bc2e-e70cd89e3943 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.853843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1055/2140] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:46 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:46.855327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.868913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439231-c282-45b7-b22e-7c47c522b8b6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.910724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.911015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.911745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.930058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] MFA Rules not processed for user `59470153a65143c58b0a9ea79956622e`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:46.930478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.931141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.931308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:46.931430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.931852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.932696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.935405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.963165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1086/2141] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:46 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:46.964206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:46.975182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afe57-c390-48b1-b996-964c4c185d54 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:46.981033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:46.981769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:46.982031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:46.982565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:46.983651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:46.985652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:46.997321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1087/2142] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:47.002050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.012555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1056/2143] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:47.013275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d915c7-d4d2-4cdd-8f86-2b2d01f61c8d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.018522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.019080 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.019367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.019642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.020769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.022071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.037318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1088/2144] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:47.038298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.050870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d835f-a063-4ae7-9c1a-0c58bf2050cd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.056444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b390492-5f5e-44f2-ac0f-c5a950b82756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.057323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b390492-5f5e-44f2-ac0f-c5a950b82756 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.057707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b390492-5f5e-44f2-ac0f-c5a950b82756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.057990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b390492-5f5e-44f2-ac0f-c5a950b82756 admin admin] PATH_INFO: `/v3/projects/8e934d9d244c4874a877494f5738d56b/users/451b5e2abc434fd0bf9c32acbc318718/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.078078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b390492-5f5e-44f2-ac0f-c5a950b82756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e934d9d244c4874a877494f5738d56b, user_id=451b5e2abc434fd0bf9c32acbc318718, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.085871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b390492-5f5e-44f2-ac0f-c5a950b82756 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.087723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.089705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.112845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1057/2145] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:47 2022] PUT /identity/v3/projects/8e934d9d244c4874a877494f5738d56b/users/451b5e2abc434fd0bf9c32acbc318718/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:47.115475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c131eb-cdfd-42bf-a2f4-d3f20691ec55 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.124588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.124871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.125164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.153214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] MFA Rules not processed for user `451b5e2abc434fd0bf9c32acbc318718`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:47.154794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.199706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.200509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.201525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.201525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] PATH_INFO: `/v3/users/b200433709714c349c1077a61e6d3926` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.202310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b200433709714c349c1077a61e6d3926)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.204245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.237604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1058/2146] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:47.242235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.256347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d62a3-cba4-462d-a3c8-5b3734a376d3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.259554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b200433709714c349c1077a61e6d3926'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:47.261785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.262215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.262552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.262856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.263588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.265546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.272462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b200433709714c349c1077a61e6d3926'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:47.283175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b200433709714c349c1077a61e6d3926'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:47.284473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b200433709714c349c1077a61e6d3926'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:47.293819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7af1623a-7862-4087-a814-bb7b3fdb7b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b200433709714c349c1077a61e6d3926'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:47.294812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1059/2147] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:47 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:47.299314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.307458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1089/2148] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:47 2022] DELETE /identity/v3/users/b200433709714c349c1077a61e6d3926 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:47.312869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.313382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.313786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.332833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:47.334086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.371063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b90e8f-adc3-484c-bde9-9dd783e8f1e5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.398965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1090/2149] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:47.406100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.407949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.439176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.439979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.440340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.440687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.441768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.443636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.466711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1060/2150] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:47 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:47.469744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0de29-97a0-42ad-b630-9fb62091f6d3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.470726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.472375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.473671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.474621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.474968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.475305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.484580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869162be-2392-4909-a516-bf34c5faaac5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.487699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.489131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.489478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.490231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.490586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.490935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.491731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.493380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.499055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1091/2151] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:47.503943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1061/2152] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:47.507859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.517625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b548c-db3d-4d78-a26d-3cd793e867bb service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.522360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.523261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.523544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.523835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] PATH_INFO: `/v3/projects/f73c08b8d3eb44949a01ee3e585feb74/users/dd2e1d31cb7049519139c7a31d16b578/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.540265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73c08b8d3eb44949a01ee3e585feb74, user_id=dd2e1d31cb7049519139c7a31d16b578, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.543752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.558287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1092/2153] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:47 2022] PUT /identity/v3/projects/f73c08b8d3eb44949a01ee3e585feb74/users/dd2e1d31cb7049519139c7a31d16b578/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:47.562236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.574123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7775925-769b-4b2a-b52c-7ec21b6c9b94 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.641404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c466a-847b-497f-96f7-ed973aff68b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.642104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c466a-847b-497f-96f7-ed973aff68b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.642385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c466a-847b-497f-96f7-ed973aff68b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.643017 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c466a-847b-497f-96f7-ed973aff68b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.643376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c466a-847b-497f-96f7-ed973aff68b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.645002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c466a-847b-497f-96f7-ed973aff68b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.655524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1062/2154] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:47.660107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.672898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ee45-c0c4-47f2-b680-545fce2253bb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.679969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.681654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.682014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.682359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] PATH_INFO: `/v3/projects/f73c08b8d3eb44949a01ee3e585feb74/users/dd2e1d31cb7049519139c7a31d16b578/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.685994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73c08b8d3eb44949a01ee3e585feb74, user_id=dd2e1d31cb7049519139c7a31d16b578, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.689732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.708906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1093/2155] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:47 2022] PUT /identity/v3/projects/f73c08b8d3eb44949a01ee3e585feb74/users/dd2e1d31cb7049519139c7a31d16b578/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:47.720617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.721404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.722350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.757150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] MFA Rules not processed for user `dd2e1d31cb7049519139c7a31d16b578`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:47.758481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.853728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1063/2156] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:47.861703 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:47.863544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:47.935792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23030a-5225-4ad7-92fb-e75853977459 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:47.941311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:47.942539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:47.942902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:47.943235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:47.964628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:47.967105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:47.977574 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1094/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:48.046958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:48.048101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:48.143780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:48.173803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289dbb5-e72d-4b0d-a80b-57ea420baaa2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:48.179446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:48.180373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:48.180662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:48.180939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] PATH_INFO: `/v3/projects/0f2a5f9b612d47988447fe20a713f830` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:48.182248 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2a5f9b612d47988447fe20a713f830)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:48.185227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:48.232613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711437e4-ec54-4955-92b7-1fa21bb49b23 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:48.245752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2a5f9b612d47988447fe20a713f830', 'request_id': 'req-765a4243-d977-4ad5-ba1f-cc104988fa1d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.265065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2a5f9b612d47988447fe20a713f830', 'request_id': 'req-765a4243-d977-4ad5-ba1f-cc104988fa1d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.275181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2a5f9b612d47988447fe20a713f830', 'request_id': 'req-765a4243-d977-4ad5-ba1f-cc104988fa1d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.289002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] The token cache is being invalidate because project 0f2a5f9b612d47988447fe20a713f830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:48.289528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.290386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.292312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1064/2158] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:48 2022] DELETE /identity/v3/projects/0f2a5f9b612d47988447fe20a713f830 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:48.297784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:48.299992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:48.310259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:48.314761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:48.315049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:48.315327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] PATH_INFO: `/v3/users/451b5e2abc434fd0bf9c32acbc318718` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:48.317429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=451b5e2abc434fd0bf9c32acbc318718)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:48.319468 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:48.371020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451b5e2abc434fd0bf9c32acbc318718'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.380904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a4243-d977-4ad5-ba1f-cc104988fa1d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:48.383548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451b5e2abc434fd0bf9c32acbc318718'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.388558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:48.389916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:48.390299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:48.390509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] PATH_INFO: `/v3/users/ebbad073a8974247b9fcd8e3bef2855f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:48.391961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbad073a8974247b9fcd8e3bef2855f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:48.394503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451b5e2abc434fd0bf9c32acbc318718'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.394624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:48.395216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451b5e2abc434fd0bf9c32acbc318718'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.403239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4df01dc4-5428-4819-95ab-f7bbf0528b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451b5e2abc434fd0bf9c32acbc318718'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.417659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1095/2159] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:48 2022] DELETE /identity/v3/users/451b5e2abc434fd0bf9c32acbc318718 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:48.419201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:48.419496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:48.419779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:48.437503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:48.438781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:48.451751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbad073a8974247b9fcd8e3bef2855f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.466185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbad073a8974247b9fcd8e3bef2855f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.466928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbad073a8974247b9fcd8e3bef2855f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.474950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbad073a8974247b9fcd8e3bef2855f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.483706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbad073a8974247b9fcd8e3bef2855f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.491682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1065/2160] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:48 2022] DELETE /identity/v3/users/ebbad073a8974247b9fcd8e3bef2855f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:48.504216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1096/2161] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:48.515064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:48.516628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:48.575682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd626a-be6d-44e5-ad10-a478947972ea admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:48.579683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89d7e-d205-42d6-8a55-e43206daa109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:48.580365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89d7e-d205-42d6-8a55-e43206daa109 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:48.580650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89d7e-d205-42d6-8a55-e43206daa109 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:48.580931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89d7e-d205-42d6-8a55-e43206daa109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:48.642339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89d7e-d205-42d6-8a55-e43206daa109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:48.643800 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89d7e-d205-42d6-8a55-e43206daa109 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:48.654247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1066/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:48.859624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:48.861196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:48.885441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b16e5-2ce0-4425-8a0c-55dd0dc2400c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:48.891528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:48.892890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:48.892890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:48.893172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] PATH_INFO: `/v3/projects/a90627f28678471fa229bf47857860a5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:48.895024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90627f28678471fa229bf47857860a5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:48.896967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:48.963317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90627f28678471fa229bf47857860a5', 'request_id': 'req-44323084-4b29-494d-9faf-6838ac61c128'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.976020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90627f28678471fa229bf47857860a5', 'request_id': 'req-44323084-4b29-494d-9faf-6838ac61c128'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:48.986252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90627f28678471fa229bf47857860a5', 'request_id': 'req-44323084-4b29-494d-9faf-6838ac61c128'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.005739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] The token cache is being invalidate because project a90627f28678471fa229bf47857860a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:49.006143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.007011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.017617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1097/2163] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:48 2022] DELETE /identity/v3/projects/a90627f28678471fa229bf47857860a5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:49.019324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e009-f4db-4bdb-af56-ae0f70d17eca None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.019614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e009-f4db-4bdb-af56-ae0f70d17eca None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.019893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e009-f4db-4bdb-af56-ae0f70d17eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.040573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b972e009-f4db-4bdb-af56-ae0f70d17eca None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:49.041851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b972e009-f4db-4bdb-af56-ae0f70d17eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.065882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.067310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.137628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1067/2164] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:49.144519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.144888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.145179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.157794 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323084-4b29-494d-9faf-6838ac61c128 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.162772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.163755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.164046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.164603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] PATH_INFO: `/v3/projects/8e934d9d244c4874a877494f5738d56b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.165857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e934d9d244c4874a877494f5738d56b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.167991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.171068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:49.172349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.185741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1068/2165] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:49.187107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.196698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812d13-9ad0-4497-a9e7-ee821941fced None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.202061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.202702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.203028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.203328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.204216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:49.204531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.206485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.220179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1069/2166] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:49.226119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.238478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556aabe-184b-428e-885d-fa10a222fc41 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.238781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e934d9d244c4874a877494f5738d56b', 'request_id': 'req-5c3adb2d-41ba-4138-994f-fb060d6b1008'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.247302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e934d9d244c4874a877494f5738d56b', 'request_id': 'req-5c3adb2d-41ba-4138-994f-fb060d6b1008'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.255504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e934d9d244c4874a877494f5738d56b', 'request_id': 'req-5c3adb2d-41ba-4138-994f-fb060d6b1008'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.267392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] The token cache is being invalidate because project 8e934d9d244c4874a877494f5738d56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:49.267674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.268345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.270099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1098/2167] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:49 2022] DELETE /identity/v3/projects/8e934d9d244c4874a877494f5738d56b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:49.273853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.275616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.302503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.303310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.303654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.303993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.304753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.306997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.335018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1070/2168] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:49.338963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.341226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.342826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3adb2d-41ba-4138-994f-fb060d6b1008 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.401909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.403382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.403664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.403967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] PATH_INFO: `/v3/users/dd2e1d31cb7049519139c7a31d16b578` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.405244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2e1d31cb7049519139c7a31d16b578)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.406561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69e3e-8b78-4646-84e9-74cf75652b94 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.407206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.411767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.412693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.413024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.413285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.414045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.416474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.445212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1071/2169] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:49.446276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.457098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25860b31-803f-444f-91a0-7db69ba5b93d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.462476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.463209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.463681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.464022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.465453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.467157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2e1d31cb7049519139c7a31d16b578'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.467583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.479192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1072/2170] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:49.482037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2e1d31cb7049519139c7a31d16b578'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.483251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.494975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf38fe-4a3e-40fe-8c9f-5acb6a7bd457 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.499741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2e1d31cb7049519139c7a31d16b578'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.500606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.501293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2e1d31cb7049519139c7a31d16b578'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.501614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.501975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.502326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.503135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.504821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.511553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5245bd02-91fa-4dab-a94d-f2204d6b48bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2e1d31cb7049519139c7a31d16b578'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:49.516139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1073/2171] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:49.520300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.525653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1099/2172] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:49 2022] DELETE /identity/v3/users/dd2e1d31cb7049519139c7a31d16b578 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:49.534935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.555345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2126010-38f0-4c28-8522-4c7d17df3d1e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.624184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.624989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.625271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.625544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] PATH_INFO: `/v3/projects/ac6589a262e348b9ab5ad3dd99419e26/users/4e86adc5d2a048129d1b4fe12c404096/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.641104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6589a262e348b9ab5ad3dd99419e26, user_id=4e86adc5d2a048129d1b4fe12c404096, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.643937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.659313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1074/2173] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:49 2022] PUT /identity/v3/projects/ac6589a262e348b9ab5ad3dd99419e26/users/4e86adc5d2a048129d1b4fe12c404096/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:49.670130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.670418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.670702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.698085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] MFA Rules not processed for user `4e86adc5d2a048129d1b4fe12c404096`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:49.699915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:49.765435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1100/2174] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:49.769974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.833383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e3de-50b6-4836-b0e1-d84a709e821b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.841707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.842413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.842765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.843086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.843792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.845841 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.873695 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1075/2175] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:49.877167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.888825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa050-913a-417d-bac1-65b12f9efbd4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.946354 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.947132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.947467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.947750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.948444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.950979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:49.972068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1101/2176] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:49 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:49.976107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:49.986602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3bf6-e389-4137-86af-28ae367ce459 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:49.991717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:49.992464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:49.992753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:49.993033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:49.993802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:49.995612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.007568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1076/2177] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:50.012223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.024325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8eaf7-2ddb-4f52-9754-6b69063088f7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.030233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa085338-6efc-40f7-a56d-7f12154fd7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.030964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa085338-6efc-40f7-a56d-7f12154fd7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.031383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa085338-6efc-40f7-a56d-7f12154fd7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.032072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa085338-6efc-40f7-a56d-7f12154fd7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.032783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa085338-6efc-40f7-a56d-7f12154fd7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.034741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa085338-6efc-40f7-a56d-7f12154fd7d4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.047132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1102/2178] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:50.051333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.062752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57ac9d-6898-4978-b304-ace0401494c4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.067820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.068773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.069094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.069415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] PATH_INFO: `/v3/projects/5f1f4e3fe4774c9eafde1e9cbb558a20/users/e8438d80b6be43d6825c48ba5be478bf/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.085256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1f4e3fe4774c9eafde1e9cbb558a20, user_id=e8438d80b6be43d6825c48ba5be478bf, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.087949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.111457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1077/2179] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:50 2022] PUT /identity/v3/projects/5f1f4e3fe4774c9eafde1e9cbb558a20/users/e8438d80b6be43d6825c48ba5be478bf/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:50.113023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.113318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.113616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.134029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.138338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:50.155824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] MFA Rules not processed for user `e8438d80b6be43d6825c48ba5be478bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:50.157114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:50.214824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2892c3-a9f5-4cbb-bbe9-554c26cb7e40 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.220481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.221544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.222020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.222444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] PATH_INFO: `/v3/projects/f73c08b8d3eb44949a01ee3e585feb74` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.223767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73c08b8d3eb44949a01ee3e585feb74)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.225976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.252865 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1103/2180] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:50.257429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.269959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1223-fb36-4d14-9054-246e6201ac2c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.278136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.280533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.281066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.281673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.283279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.285816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.317094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73c08b8d3eb44949a01ee3e585feb74', 'request_id': 'req-fbd536f9-ec18-44b6-aa7d-9096996c32f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:50.325868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73c08b8d3eb44949a01ee3e585feb74', 'request_id': 'req-fbd536f9-ec18-44b6-aa7d-9096996c32f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:50.330924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1104/2181] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:50.333757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73c08b8d3eb44949a01ee3e585feb74', 'request_id': 'req-fbd536f9-ec18-44b6-aa7d-9096996c32f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:50.335830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.344804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] The token cache is being invalidate because project f73c08b8d3eb44949a01ee3e585feb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:50.345086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:50.346014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fbd536f9-ec18-44b6-aa7d-9096996c32f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:50.348037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1078/2182] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:50 2022] DELETE /identity/v3/projects/f73c08b8d3eb44949a01ee3e585feb74 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:50.356700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88afd3-9782-4960-bf58-2c6bee6fa10a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.356988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88afd3-9782-4960-bf58-2c6bee6fa10a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.357731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88afd3-9782-4960-bf58-2c6bee6fa10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.381616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8a88afd3-9782-4960-bf58-2c6bee6fa10a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:50.383122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8a88afd3-9782-4960-bf58-2c6bee6fa10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:50.418725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277aaf-8dea-4c5e-9f24-1b0ee9157def admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.424235 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.424985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.425373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.425761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.426727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.428814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.459047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1105/2183] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:50.462869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.466380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:50.479443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1079/2184] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:50.489215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.489656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.489944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.492246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190a043-bd22-4b1c-b3bb-0491eadc9e74 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.498717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.499646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.499980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.500323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.501436 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.511222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.515309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:50.516438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:50.526027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1080/2185] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:50.530475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.531531 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1106/2186] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:50.536306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.547285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261a2e-c148-4fb7-89ca-679d4e5092ce admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.549964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9abdde-077d-4f53-a926-8d154bff6640 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.552557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.553633 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.554054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.554402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] PATH_INFO: `/v3/projects/1c5cc549cd6746088621e37d71f31735/users/b8b1407703274854a89e4487636a12bd/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.555300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.556037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.556526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.557049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.558832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:50.559845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.561640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.573610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5cc549cd6746088621e37d71f31735, user_id=b8b1407703274854a89e4487636a12bd, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.576473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1081/2187] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:10:50.578049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.581620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.593183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88a0ca-bad9-4dda-a7fe-bfed59f6cc94 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.596217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1107/2188] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:50 2022] PUT /identity/v3/projects/1c5cc549cd6746088621e37d71f31735/users/b8b1407703274854a89e4487636a12bd/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:50.599939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.699529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.700211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.700497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.701112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.702381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.704971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.738804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531f225-90aa-4cf5-9e0e-f5e8e381de19 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.743981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.744659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.744941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.745223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.746244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1082/2189] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:50.746392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.747958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.750253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.759265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1108/2190] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:50.764033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.775096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499ac4-c9b7-4b30-acd6-ac85e53b0367 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.859312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780c580-b736-4f74-92b5-2232bd935f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.860059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c580-b736-4f74-92b5-2232bd935f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.860363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c580-b736-4f74-92b5-2232bd935f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.860616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c580-b736-4f74-92b5-2232bd935f51 admin admin] PATH_INFO: `/v3/projects/1c5cc549cd6746088621e37d71f31735/users/b8b1407703274854a89e4487636a12bd/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.863070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780c580-b736-4f74-92b5-2232bd935f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5cc549cd6746088621e37d71f31735, user_id=b8b1407703274854a89e4487636a12bd, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.865882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780c580-b736-4f74-92b5-2232bd935f51 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.870719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748437b1-5520-488c-9996-1527b033d319 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.881640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1109/2191] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:50 2022] PUT /identity/v3/projects/1c5cc549cd6746088621e37d71f31735/users/b8b1407703274854a89e4487636a12bd/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:50.889625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.889926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.890318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.924721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] MFA Rules not processed for user `b8b1407703274854a89e4487636a12bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:50.925992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:50.929300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.930041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.930313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.930645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.931345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.933402 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.954738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1083/2192] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:50.958720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:50.968977 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823d53-9b9a-4f10-9dc1-03b15ad83118 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:50.973732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:50.974400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:50.974687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:50.975166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:50.975928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:50.977440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:50.988596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1084/2193] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:50.992367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.002053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f450-cd71-4c50-bade-1cf3018560ab admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.007851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1110/2194] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:51.010405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.011232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.012039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.012337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.013061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.014686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.016796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.018185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:51.025587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1085/2195] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:51.030305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.041358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8654f8-75ee-4548-8afd-b23bf5ca6ae8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.046986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b97a-1cd0-49e3-a43b-cacd5605a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.047925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b97a-1cd0-49e3-a43b-cacd5605a029 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.048212 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b97a-1cd0-49e3-a43b-cacd5605a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.048490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b97a-1cd0-49e3-a43b-cacd5605a029 admin admin] PATH_INFO: `/v3/projects/fd55e3ef984e4954bc8758934ee5b1e5/users/5fc3937115324edb8c8129f924178e59/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.067690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b97a-1cd0-49e3-a43b-cacd5605a029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd55e3ef984e4954bc8758934ee5b1e5, user_id=5fc3937115324edb8c8129f924178e59, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.070528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b97a-1cd0-49e3-a43b-cacd5605a029 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.080256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffc00-e59a-41d6-b9b2-4af975e8902f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.087268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1086/2196] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:51 2022] PUT /identity/v3/projects/fd55e3ef984e4954bc8758934ee5b1e5/users/5fc3937115324edb8c8129f924178e59/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:51.098208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.098496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.098773 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.127702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] MFA Rules not processed for user `5fc3937115324edb8c8129f924178e59`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:51.128915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:51.149156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.149366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.149767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.150318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.151772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:51.198906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1087/2197] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:10:51.203866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.213899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.215795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.226232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1111/2198] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:10:51.268746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d376658-ba4c-4a1a-985a-90e28811ce32 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.274197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.274893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.275258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.275538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.276222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.278192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.305217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1088/2199] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:51 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:10:51.310090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.320695 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fad9e-decd-4ead-84d5-75c03cf4656e service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.376898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.377585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.377872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.378149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.378847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.380927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.403785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1112/2200] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:51 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:51.404893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.415601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04220-7be6-4010-b69e-b862f7516446 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.420538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.421231 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.421684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.422058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.422781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.424737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.437807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1089/2201] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:51.441851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.453284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375a3a0-a852-4ec8-9337-d08836b8d2fb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.458598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236af4-8bf0-47ec-a59e-82d261a2e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.459366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236af4-8bf0-47ec-a59e-82d261a2e608 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.459654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236af4-8bf0-47ec-a59e-82d261a2e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.459930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236af4-8bf0-47ec-a59e-82d261a2e608 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.460712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4236af4-8bf0-47ec-a59e-82d261a2e608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.462485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4236af4-8bf0-47ec-a59e-82d261a2e608 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.486058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1113/2202] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:51.487237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.508478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1f31-22ef-4818-b5a5-2e677e79c306 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.524194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.525482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.525941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.526420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] PATH_INFO: `/v3/projects/bf2d5c7be9f2495db8f8ce5bdd414f57/users/dab1e7a1306e426a9f6767ee371f171f/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.557165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2d5c7be9f2495db8f8ce5bdd414f57, user_id=dab1e7a1306e426a9f6767ee371f171f, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.557165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.585588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1090/2203] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:51 2022] PUT /identity/v3/projects/bf2d5c7be9f2495db8f8ce5bdd414f57/users/dab1e7a1306e426a9f6767ee371f171f/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:51.592265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.592564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.592856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.620952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] MFA Rules not processed for user `dab1e7a1306e426a9f6767ee371f171f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:51.622708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:51.688396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1114/2204] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:51.692921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.760811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb31d3-8c21-46e1-ae2a-53b63af78ff5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.765587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.766255 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.766541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.766820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.767526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.769434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.799383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1091/2205] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:51 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:51.800904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.813312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270d98d-17b2-49ac-ba8a-173e0fdaae20 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.928404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.929092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.929374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.929679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.930391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.932308 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.955492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1115/2206] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:10:51 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:10:51.956979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:51.968108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758ce03-9eee-4b3c-937c-a7c0b65d834b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:51.972696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:51.973358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:51.973679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:51.973956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:51.974671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:51.976310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:51.987345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1092/2207] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:10:51.991579 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:52.001622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dee6a-9bc1-4e6b-b375-4a8aa86d501e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:52.006311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:52.007262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.007613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.007960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] PATH_INFO: `/v3/projects/71f8d0c91e4b495395426bc2e7dd2a5b/users/f80678084564432bab8876c520c49113/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.022958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f8d0c91e4b495395426bc2e7dd2a5b, user_id=f80678084564432bab8876c520c49113, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:52.025737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:52.039178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1116/2208] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:51 2022] PUT /identity/v3/projects/71f8d0c91e4b495395426bc2e7dd2a5b/users/f80678084564432bab8876c520c49113/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:52.043729 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:52.053391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5e7c-5ab8-4e74-985f-a3c5ca3dba83 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:52.107426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ee99a-53d1-4875-9d0d-55bf3453226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:52.108115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee99a-53d1-4875-9d0d-55bf3453226a admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.108392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee99a-53d1-4875-9d0d-55bf3453226a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.108664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee99a-53d1-4875-9d0d-55bf3453226a admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.109404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ee99a-53d1-4875-9d0d-55bf3453226a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:52.111138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ee99a-53d1-4875-9d0d-55bf3453226a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:52.120573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1093/2209] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:10:52.124664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:52.134527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a156e5-f6ef-4d30-ba04-233e227e2304 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:52.139045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:52.139910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.140188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.140456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] PATH_INFO: `/v3/projects/71f8d0c91e4b495395426bc2e7dd2a5b/users/f80678084564432bab8876c520c49113/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.142441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f8d0c91e4b495395426bc2e7dd2a5b, user_id=f80678084564432bab8876c520c49113, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:52.145200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:52.155956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1117/2210] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:10:52 2022] PUT /identity/v3/projects/71f8d0c91e4b495395426bc2e7dd2a5b/users/f80678084564432bab8876c520c49113/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:52.169126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.169413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.169781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.196584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] MFA Rules not processed for user `f80678084564432bab8876c520c49113`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:52.197735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:52.267722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1094/2211] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:52.279992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:52.281767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:52.337474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d265-3c3e-41a7-9a7b-c77e08ebed16 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:52.341335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:52.342084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.342356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.342628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.351762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:52.353171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:52.363023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1118/2212] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:52.405106 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:52.414669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cdd87-51b3-4108-b05b-e553d0543d9c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:52.418941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:52.419830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.420389 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.420720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.475964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:52.477406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:52.486690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1095/2213] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:52.830685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:52.844996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80289-a24f-48a5-91e4-8ea40e86392d service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:52.848882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:52.849690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:52.849975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:52.850249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:52.853412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:52.919042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:52.920964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:52.937438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1119/2214] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:53.497706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:53.506037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8c25-896b-4841-b972-f3a6c4019777 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:53.509657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfbb36-63a3-4064-a927-5996ae33602c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:53.510289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfbb36-63a3-4064-a927-5996ae33602c service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:53.510574 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfbb36-63a3-4064-a927-5996ae33602c service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:53.510853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfbb36-63a3-4064-a927-5996ae33602c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:53.568968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfbb36-63a3-4064-a927-5996ae33602c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:53.570364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfbb36-63a3-4064-a927-5996ae33602c service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:53.580159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1096/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:57.489457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:57.551446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f722b-5c6c-4a86-8867-38a08ea1bc69 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:57.555788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:57.556645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:57.556922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:57.557198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] PATH_INFO: `/v3/users/5fc3937115324edb8c8129f924178e59` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:57.558400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc3937115324edb8c8129f924178e59)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:57.560329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:57.606092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc3937115324edb8c8129f924178e59'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:57.617035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc3937115324edb8c8129f924178e59'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:57.624367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc3937115324edb8c8129f924178e59'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:57.625086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc3937115324edb8c8129f924178e59'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:57.632055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc3937115324edb8c8129f924178e59'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:57.638674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1120/2216] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:57 2022] DELETE /identity/v3/users/5fc3937115324edb8c8129f924178e59 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:57.643290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:57.643755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:57.643974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:57.661952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:57.663141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:57.738860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1097/2217] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:57.746917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:57.748480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:57.812660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9e29-ba19-4373-ad82-f4271edf5778 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:57.816994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:57.817680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:57.817954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:57.818224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:57.830446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:57.831874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:57.843049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1121/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:58.170909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:58.172384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:58.186307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072833a-3f1a-432b-970d-0f7e296ec487 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:58.191125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:58.191838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:58.192131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:58.192410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] PATH_INFO: `/v3/projects/fd55e3ef984e4954bc8758934ee5b1e5` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:58.193647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd55e3ef984e4954bc8758934ee5b1e5)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:58.195559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:58.248826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd55e3ef984e4954bc8758934ee5b1e5', 'request_id': 'req-753172d2-9056-4608-808c-76aa57f10648'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.257814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd55e3ef984e4954bc8758934ee5b1e5', 'request_id': 'req-753172d2-9056-4608-808c-76aa57f10648'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.264708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd55e3ef984e4954bc8758934ee5b1e5', 'request_id': 'req-753172d2-9056-4608-808c-76aa57f10648'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.275093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] The token cache is being invalidate because project fd55e3ef984e4954bc8758934ee5b1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:58.275965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.276616 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.279083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1098/2219] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:58 2022] DELETE /identity/v3/projects/fd55e3ef984e4954bc8758934ee5b1e5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:58.283489 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:58.295724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eecb9-52bc-48a5-bc4b-ba6a098fb56a service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:58.365890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:58.365890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:58.365890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:58.365890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] PATH_INFO: `/v3/users/dab1e7a1306e426a9f6767ee371f171f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:58.366903 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab1e7a1306e426a9f6767ee371f171f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:58.368899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:58.466701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab1e7a1306e426a9f6767ee371f171f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.486189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab1e7a1306e426a9f6767ee371f171f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.498345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab1e7a1306e426a9f6767ee371f171f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.499397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab1e7a1306e426a9f6767ee371f171f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.518032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab1e7a1306e426a9f6767ee371f171f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:58.520696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1122/2220] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:58 2022] DELETE /identity/v3/users/dab1e7a1306e426a9f6767ee371f171f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:10:58.885663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:58.887677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:58.900736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753172d2-9056-4608-808c-76aa57f10648 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:58.961045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:58.961934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:58.962214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:58.962541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] PATH_INFO: `/v3/projects/bf2d5c7be9f2495db8f8ce5bdd414f57` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:58.963867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2d5c7be9f2495db8f8ce5bdd414f57)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:58.965810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.015145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2d5c7be9f2495db8f8ce5bdd414f57', 'request_id': 'req-519cb522-ec97-4e22-889f-b142231d7c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.022685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2d5c7be9f2495db8f8ce5bdd414f57', 'request_id': 'req-519cb522-ec97-4e22-889f-b142231d7c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.031968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2d5c7be9f2495db8f8ce5bdd414f57', 'request_id': 'req-519cb522-ec97-4e22-889f-b142231d7c77'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.043744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] The token cache is being invalidate because project bf2d5c7be9f2495db8f8ce5bdd414f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:59.044026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.044682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-519cb522-ec97-4e22-889f-b142231d7c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.046268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1099/2221] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:58 2022] DELETE /identity/v3/projects/bf2d5c7be9f2495db8f8ce5bdd414f57 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:59.050454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.051925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.065350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33140287-074d-4e88-a744-143a5c9205a9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.124512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.125392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.125704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.126050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] PATH_INFO: `/v3/users/f80678084564432bab8876c520c49113` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.127198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80678084564432bab8876c520c49113)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.129105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.174600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80678084564432bab8876c520c49113'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.186441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80678084564432bab8876c520c49113'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.195072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80678084564432bab8876c520c49113'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.195316 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80678084564432bab8876c520c49113'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.203471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f3c34caa-c450-4319-9925-009531fc8f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80678084564432bab8876c520c49113'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.212945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1123/2222] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:59 2022] DELETE /identity/v3/users/f80678084564432bab8876c520c49113 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:59.215844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8dbc-8302-4f4d-85b9-ba6f08a4f919 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.216291 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8dbc-8302-4f4d-85b9-ba6f08a4f919 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.216761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8dbc-8302-4f4d-85b9-ba6f08a4f919 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.220589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1100/2223] 10.222.0.20 () {54 vars in 960 bytes} [Thu Apr 28 14:10:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:10:59.228997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.229533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.231686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.322018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] MFA Rules not processed for user `590c10bbd98b4dabbb7c35d389bf7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:59.323273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.423710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1124/2224] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Apr 28 14:10:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:59.431430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8dbc-8302-4f4d-85b9-ba6f08a4f919 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.447693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8dbc-8302-4f4d-85b9-ba6f08a4f919 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.453601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.454254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.454542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.454823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.456692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.469845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.471496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.482060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1101/2225] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:59.503061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.504577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.578133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b6f20-78d2-4439-bc82-0934b63237db None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.582829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.583688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.583971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.584248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] PATH_INFO: `/v3/projects/71f8d0c91e4b495395426bc2e7dd2a5b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.585501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f8d0c91e4b495395426bc2e7dd2a5b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.588062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.590813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.592169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.605360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60befd-58f9-411c-931e-04f454a6aa54 service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.611501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.612366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.612644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.612915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] PATH_INFO: `/v3/users/4e86adc5d2a048129d1b4fe12c404096` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.614211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e86adc5d2a048129d1b4fe12c404096)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.616476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.643274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f8d0c91e4b495395426bc2e7dd2a5b', 'request_id': 'req-401969c1-d131-4205-9f31-26e9f7fa0c42'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.651846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f8d0c91e4b495395426bc2e7dd2a5b', 'request_id': 'req-401969c1-d131-4205-9f31-26e9f7fa0c42'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.660065 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f8d0c91e4b495395426bc2e7dd2a5b', 'request_id': 'req-401969c1-d131-4205-9f31-26e9f7fa0c42'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.669150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e86adc5d2a048129d1b4fe12c404096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.672305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] The token cache is being invalidate because project 71f8d0c91e4b495395426bc2e7dd2a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:10:59.672587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.673746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-401969c1-d131-4205-9f31-26e9f7fa0c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.677736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1125/2226] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:10:59 2022] DELETE /identity/v3/projects/71f8d0c91e4b495395426bc2e7dd2a5b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:59.682702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e86adc5d2a048129d1b4fe12c404096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.683351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582676af-8308-4671-9b68-9d0450fa72f5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.683466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e86adc5d2a048129d1b4fe12c404096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.683637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582676af-8308-4671-9b68-9d0450fa72f5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.683948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582676af-8308-4671-9b68-9d0450fa72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.690508 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e86adc5d2a048129d1b4fe12c404096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.702130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0702fb8b-4247-40af-8d74-ef904d7111ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e86adc5d2a048129d1b4fe12c404096'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:10:59.710121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1102/2227] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:10:59 2022] DELETE /identity/v3/users/4e86adc5d2a048129d1b4fe12c404096 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:10:59.716189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.716475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.716816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.718117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-582676af-8308-4671-9b68-9d0450fa72f5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:59.719362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-582676af-8308-4671-9b68-9d0450fa72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.738435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:59.740191 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.802510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1103/2228] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:59.821438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.822982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.856800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1126/2229] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:59.858679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.859182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.859653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.879215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:10:59.880616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:10:59.894824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1127/2230] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:10:59.895997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.899561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc90b-64db-44aa-a732-90a1ce8316d5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.906469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fa75a-4c57-48fe-9b4c-731b342b02f8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.906601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.908327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.908853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.909153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.912423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.913144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.913652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.914110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.915036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:10:59.915487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.917238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.921870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.923824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:10:59.932179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1128/2231] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:10:59.937541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:10:59.939393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1104/2232] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:10:59.947963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880d0f-edb4-4515-a7ec-360694807dd8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:10:59.956907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:10:59.957844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:10:59.958271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:10:59.959490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:10:59.959490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:10:59.962104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.000560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1129/2233] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:10:59 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:00.004623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.015422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9d5a-4ea1-43a6-868b-a6760b216115 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.073110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.073814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.074104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.074916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.075649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.077589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.097801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1105/2234] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:00 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:11:00.101800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.112434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378e21-ea37-4e23-b179-a7162615662f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.118105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.118772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.119054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.119338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.120179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.122411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.132929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1130/2235] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:00.140355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.151247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973f65c-f5cc-4942-b826-998b9477249e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.156920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.158477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.158477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.158871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.159888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.161624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.171682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1106/2236] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:00.175760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.195815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655fadb-7d8f-4f17-a2d4-7b54c3d47721 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.205441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910c6b-a823-4859-b16d-2b2c6e3aa71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.206465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910c6b-a823-4859-b16d-2b2c6e3aa71f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.206753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910c6b-a823-4859-b16d-2b2c6e3aa71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.207033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910c6b-a823-4859-b16d-2b2c6e3aa71f admin admin] PATH_INFO: `/v3/projects/2a73a7474c404cc1b79a92058de39d48/users/1684e743d6384e0a9209a7510e3903a3/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.224029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910c6b-a823-4859-b16d-2b2c6e3aa71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a73a7474c404cc1b79a92058de39d48, user_id=1684e743d6384e0a9209a7510e3903a3, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.226893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910c6b-a823-4859-b16d-2b2c6e3aa71f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.241615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1131/2237] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:00 2022] PUT /identity/v3/projects/2a73a7474c404cc1b79a92058de39d48/users/1684e743d6384e0a9209a7510e3903a3/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:00.241902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.247434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:00.253147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.253582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.253927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.261834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469ebfa-a47c-4c4d-9a14-5dc3f963f233 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.287437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] MFA Rules not processed for user `1684e743d6384e0a9209a7510e3903a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:00.289218 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:00.332249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.332484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.332857 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.333653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] PATH_INFO: `/v3/projects/ac6589a262e348b9ab5ad3dd99419e26` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.335069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6589a262e348b9ab5ad3dd99419e26)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.337097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.381413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1132/2238] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:11:00.385688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.391558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6589a262e348b9ab5ad3dd99419e26', 'request_id': 'req-d828e7cf-e69f-49ef-a805-da25fb6ece8c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.397160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4e01-0d8a-4595-be5c-dfb0117589d7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.398785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6589a262e348b9ab5ad3dd99419e26', 'request_id': 'req-d828e7cf-e69f-49ef-a805-da25fb6ece8c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.405279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6589a262e348b9ab5ad3dd99419e26', 'request_id': 'req-d828e7cf-e69f-49ef-a805-da25fb6ece8c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.416257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] The token cache is being invalidate because project ac6589a262e348b9ab5ad3dd99419e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:00.416548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.417206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.418840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1107/2239] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:00 2022] DELETE /identity/v3/projects/ac6589a262e348b9ab5ad3dd99419e26 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:00.422520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.423825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:00.457117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.457806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.458094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.459087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.459087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.461042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.490362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1133/2240] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:11:00 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:11:00.490579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828e7cf-e69f-49ef-a805-da25fb6ece8c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.491423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.492982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:00.549282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.550406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.550797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.551273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] PATH_INFO: `/v3/users/e8438d80b6be43d6825c48ba5be478bf` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.557381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8438d80b6be43d6825c48ba5be478bf)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.560380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.563818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2960db-3f95-4d91-b25b-36c70e9974be admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.569370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.570146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.571443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.571443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.572075 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.574086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.598712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1134/2241] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:00 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:00.599994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.610810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8438d80b6be43d6825c48ba5be478bf'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.611594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27240e86-c1a4-4d2c-a6d7-1c944170e7a7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.616515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.617176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.617457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.617766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.618495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.620089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.633325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1135/2242] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:00.633465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8438d80b6be43d6825c48ba5be478bf'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.633465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8438d80b6be43d6825c48ba5be478bf'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.634599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.639880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8438d80b6be43d6825c48ba5be478bf'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.644415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a26a6-3983-4482-a2f7-28471adaaf91 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.647151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8438d80b6be43d6825c48ba5be478bf'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:00.649896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.650753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.651064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.651336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] PATH_INFO: `/v3/projects/2edd74785954441ea77c01eae4d04b41/users/e5ade793eeca4acb9bbd7a683928f920/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.653538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1108/2243] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:00 2022] DELETE /identity/v3/users/e8438d80b6be43d6825c48ba5be478bf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:00.670100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edd74785954441ea77c01eae4d04b41, user_id=e5ade793eeca4acb9bbd7a683928f920, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.672735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.687291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1136/2244] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:00 2022] PUT /identity/v3/projects/2edd74785954441ea77c01eae4d04b41/users/e5ade793eeca4acb9bbd7a683928f920/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:00.691875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.693397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:00.762665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3f99-e963-4944-bf20-f9fbf035863e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.849821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26f042-4849-4064-ac16-71cce2b4468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.850749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f042-4849-4064-ac16-71cce2b4468d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.851206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f042-4849-4064-ac16-71cce2b4468d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.851624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f042-4849-4064-ac16-71cce2b4468d admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.852545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26f042-4849-4064-ac16-71cce2b4468d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.854243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26f042-4849-4064-ac16-71cce2b4468d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.869701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1109/2245] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:00.871854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:00.883728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699dee-6093-41e0-92ed-770191a42ff8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:00.891177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:00.892137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.892475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.892713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] PATH_INFO: `/v3/projects/2edd74785954441ea77c01eae4d04b41/users/e5ade793eeca4acb9bbd7a683928f920/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.896135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edd74785954441ea77c01eae4d04b41, user_id=e5ade793eeca4acb9bbd7a683928f920, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:00.898881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:00.918232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1137/2246] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:00 2022] PUT /identity/v3/projects/2edd74785954441ea77c01eae4d04b41/users/e5ade793eeca4acb9bbd7a683928f920/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:00.927443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:00.927843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:00.928010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:00.955275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] MFA Rules not processed for user `e5ade793eeca4acb9bbd7a683928f920`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:00.956467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:01.024715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1110/2247] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:01.040685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:01.044952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:01.081282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:01.082940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:01.144288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846ab9-d8a2-4905-ac7d-21f8e0b72790 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:01.149289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:01.150112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:01.150432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:01.151575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:01.154246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:01.182337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af08c7a-ff1a-48c5-9982-6018142d7db3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:01.187028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:01.187949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:01.188257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:01.188560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] PATH_INFO: `/v3/projects/5f1f4e3fe4774c9eafde1e9cbb558a20` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:01.189876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1f4e3fe4774c9eafde1e9cbb558a20)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:01.191889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:01.222460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:01.224490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:01.240256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1138/2248] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:01.245798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1f4e3fe4774c9eafde1e9cbb558a20', 'request_id': 'req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.254531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1f4e3fe4774c9eafde1e9cbb558a20', 'request_id': 'req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.260808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1f4e3fe4774c9eafde1e9cbb558a20', 'request_id': 'req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.272204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] The token cache is being invalidate because project 5f1f4e3fe4774c9eafde1e9cbb558a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:01.272487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.273219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.275124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1111/2249] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:01 2022] DELETE /identity/v3/projects/5f1f4e3fe4774c9eafde1e9cbb558a20 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:01.280360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:01.291191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761f39-f088-46a8-afbf-55543e71f517 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:01.348225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:01.349163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:01.349446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:01.349753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] PATH_INFO: `/v3/users/b8b1407703274854a89e4487636a12bd` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:01.350984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b1407703274854a89e4487636a12bd)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:01.353054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:01.403664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b1407703274854a89e4487636a12bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.416293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b1407703274854a89e4487636a12bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.424319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b1407703274854a89e4487636a12bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.425598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b1407703274854a89e4487636a12bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.432455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73cf81bf-ff0a-4f3e-9048-6d8dec165f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b1407703274854a89e4487636a12bd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.444178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1139/2250] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:01 2022] DELETE /identity/v3/users/b8b1407703274854a89e4487636a12bd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:01.763654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:01.766433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:01.784941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d84f-d9bb-4c4b-8887-cd66fa62ddcd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:01.852220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:01.853115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:01.853394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:01.853846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] PATH_INFO: `/v3/projects/1c5cc549cd6746088621e37d71f31735` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:01.854915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5cc549cd6746088621e37d71f31735)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:01.856848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:01.903334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5cc549cd6746088621e37d71f31735', 'request_id': 'req-8bb91bef-852a-473f-bd31-1f5d58168f85'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.911646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5cc549cd6746088621e37d71f31735', 'request_id': 'req-8bb91bef-852a-473f-bd31-1f5d58168f85'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.919069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5cc549cd6746088621e37d71f31735', 'request_id': 'req-8bb91bef-852a-473f-bd31-1f5d58168f85'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.934519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] The token cache is being invalidate because project 1c5cc549cd6746088621e37d71f31735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:01.935147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.935684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:01.937539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1112/2251] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:01 2022] DELETE /identity/v3/projects/1c5cc549cd6746088621e37d71f31735 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:01.942894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d08d-9e0c-4cb0-9b19-00852b83ccf6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:01.943356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d08d-9e0c-4cb0-9b19-00852b83ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:01.945603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d08d-9e0c-4cb0-9b19-00852b83ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:01.947622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:01.949006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:01.963588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1d46d08d-9e0c-4cb0-9b19-00852b83ccf6 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:01.964809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1d46d08d-9e0c-4cb0-9b19-00852b83ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.017412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb91bef-852a-473f-bd31-1f5d58168f85 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.022872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.023769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.024051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.024348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] PATH_INFO: `/v3/users/22459be27d334dde85abf32e9bc69cba` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.025575 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22459be27d334dde85abf32e9bc69cba)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.027936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.029203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1140/2252] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:02.039236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.039640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.040027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.061232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:02.062496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.071691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1141/2253] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:02.075760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.080663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22459be27d334dde85abf32e9bc69cba'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.084997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a251e64-1b21-4a86-91de-59fc8c41deea None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.089774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.090833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.091112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.091384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.092110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:11:02.092414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.093609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22459be27d334dde85abf32e9bc69cba'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.094114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.094496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22459be27d334dde85abf32e9bc69cba'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.102238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22459be27d334dde85abf32e9bc69cba'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.113462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1142/2254] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:11:02.117226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6370fa3a-cda9-40cd-8d90-03ceecaa31a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22459be27d334dde85abf32e9bc69cba'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.118132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.119920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.128326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1113/2255] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:01 2022] DELETE /identity/v3/users/22459be27d334dde85abf32e9bc69cba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:02.130566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.130936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.131331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.138224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c89745-52a0-428f-9adb-fb2a6fba4610 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.151713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:02.152970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.200927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.201949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.202329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.202505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.203197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.205117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.219016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1114/2256] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:11:02.228753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.230321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.241182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1143/2257] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:02.242462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.285778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2243d-2108-4296-a049-a1d06fe1b280 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.300558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732b0b-9212-47d9-9c04-53db8e16f018 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.305284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.306083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.306463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.306831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.307549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.310117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.330088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1144/2258] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:11:02.333891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.334031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.334705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.334996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.335275 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.343647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6af8-1902-4d65-9478-8c40a2b2078e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.344929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.346411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.348636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.349407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.349789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.350066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.350786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.352379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.356799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1115/2259] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:11:02.362751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1145/2260] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:11:02.366708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.376727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d277f-22f3-44d8-af58-c3d1722e6e37 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.381304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558081e0-8532-4ea3-9130-98f6e663ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.381983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558081e0-8532-4ea3-9130-98f6e663ef0f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.382266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558081e0-8532-4ea3-9130-98f6e663ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.382541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558081e0-8532-4ea3-9130-98f6e663ef0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.383254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558081e0-8532-4ea3-9130-98f6e663ef0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.384849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558081e0-8532-4ea3-9130-98f6e663ef0f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.394584 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1116/2261] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:11:02.398702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.410896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679f78-5168-4a15-ac24-4206755f4237 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.417761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.419382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.419732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.420084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] PATH_INFO: `/v3/projects/76213c7ca86e43ae835a3ca6a13220df/users/bb3586c6f035424582907d705d905acb/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.437905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76213c7ca86e43ae835a3ca6a13220df, user_id=bb3586c6f035424582907d705d905acb, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.441142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.454000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1146/2262] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:02 2022] PUT /identity/v3/projects/76213c7ca86e43ae835a3ca6a13220df/users/bb3586c6f035424582907d705d905acb/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:02.465749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.466116 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.466493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.493033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] MFA Rules not processed for user `bb3586c6f035424582907d705d905acb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:02.494262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.563583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1117/2263] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:02.576949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.578861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.644107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84506-3ad6-4118-a2e6-492e159e8160 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.649543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:02.651004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.655330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064df67-60e7-4013-83b7-cba6da6ee2b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.656776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064df67-60e7-4013-83b7-cba6da6ee2b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.657849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064df67-60e7-4013-83b7-cba6da6ee2b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.658132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064df67-60e7-4013-83b7-cba6da6ee2b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.671206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064df67-60e7-4013-83b7-cba6da6ee2b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.673249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064df67-60e7-4013-83b7-cba6da6ee2b2 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.686134 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1147/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:02.742046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbc3a3-33c9-4c75-9882-dccd6d4501df None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:02.748645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:02.749517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.749838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.750115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] PATH_INFO: `/v3/projects/b799bf4001da4a0eaef3fa60f662ea76` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.751354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b799bf4001da4a0eaef3fa60f662ea76)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:02.753289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:02.810760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b799bf4001da4a0eaef3fa60f662ea76', 'request_id': 'req-938e18cd-a418-4f2c-aadc-582d186b12f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.823138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b799bf4001da4a0eaef3fa60f662ea76', 'request_id': 'req-938e18cd-a418-4f2c-aadc-582d186b12f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.831540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b799bf4001da4a0eaef3fa60f662ea76', 'request_id': 'req-938e18cd-a418-4f2c-aadc-582d186b12f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.847225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] The token cache is being invalidate because project b799bf4001da4a0eaef3fa60f662ea76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:02.847694 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.849635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-938e18cd-a418-4f2c-aadc-582d186b12f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:02.851349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1118/2265] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:02 2022] DELETE /identity/v3/projects/b799bf4001da4a0eaef3fa60f662ea76 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:11:02.856962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.857655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.858031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.877766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:02.879117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.952042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1148/2266] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:02.961436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:02.961941 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:02.962021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:02.982178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:02.983669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:02.996818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1119/2267] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:03.004677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.017429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198a22-a89c-4247-81de-206ffe2b05d3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.023505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.024747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.025055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.025352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.026320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:11:03.026668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.028937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.042807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1149/2268] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:11:03.048351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.058351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c847b4-7bcc-4ad9-ba24-8e9d9e7d67bb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.063975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.064638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.065067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.065352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.066083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.067992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.096705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1120/2269] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:11:03 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:03.100815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.111522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627859d-e1fe-4376-a361-4409bc4c3aa7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.166807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.167465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.167742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.168013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.168686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.170625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.189801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1150/2270] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:03 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:03.193848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.204736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9fd44-a9e8-4f40-affe-23c503b43f1a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.209270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.209954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.210234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.210505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.211218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.212792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.222756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1121/2271] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:03.226539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.236373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778025-9a3f-4b11-8f72-8cae6a7eda37 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.241271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae27f-98e2-4b42-b572-9a47b5d5157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.242155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae27f-98e2-4b42-b572-9a47b5d5157a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.242324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae27f-98e2-4b42-b572-9a47b5d5157a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.242599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae27f-98e2-4b42-b572-9a47b5d5157a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.243352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae27f-98e2-4b42-b572-9a47b5d5157a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.245032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae27f-98e2-4b42-b572-9a47b5d5157a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.255784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1151/2272] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:11:03.259815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.270326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f7c93-9aa9-4af0-a873-963c7f7e6d79 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.274909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.275781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.276060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.276332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] PATH_INFO: `/v3/projects/c2bf40efd5c24ecc9604857f587c5806/users/f77dc56f8e224e7c9a6c772bb9206da7/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.291404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2bf40efd5c24ecc9604857f587c5806, user_id=f77dc56f8e224e7c9a6c772bb9206da7, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.294232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.309464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1122/2273] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:03 2022] PUT /identity/v3/projects/c2bf40efd5c24ecc9604857f587c5806/users/f77dc56f8e224e7c9a6c772bb9206da7/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:03.319741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.320036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.320319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.348576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] MFA Rules not processed for user `f77dc56f8e224e7c9a6c772bb9206da7`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:03.349906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:03.422691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1152/2274] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:03.433370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.435579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:03.491653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc5b4-31a5-4307-ad02-885dbbc3f136 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.495313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351dd4e-4e1c-4a1d-8f2d-4894a0b1bdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.495952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351dd4e-4e1c-4a1d-8f2d-4894a0b1bdae service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.496234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351dd4e-4e1c-4a1d-8f2d-4894a0b1bdae service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.496517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351dd4e-4e1c-4a1d-8f2d-4894a0b1bdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.504582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351dd4e-4e1c-4a1d-8f2d-4894a0b1bdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.506044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351dd4e-4e1c-4a1d-8f2d-4894a0b1bdae service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.515102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1123/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:03.837088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:03.838648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:03.906237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67396c1-3161-49d1-ab9a-ed45ff05aaf7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:03.911776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:03.912665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.912929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.913197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] PATH_INFO: `/v3/users/1684e743d6384e0a9209a7510e3903a3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:03.914503 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1684e743d6384e0a9209a7510e3903a3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:03.916401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:03.960136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1684e743d6384e0a9209a7510e3903a3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:03.971269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1684e743d6384e0a9209a7510e3903a3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:03.978120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1684e743d6384e0a9209a7510e3903a3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:03.978705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1684e743d6384e0a9209a7510e3903a3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:03.985256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1684e743d6384e0a9209a7510e3903a3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:03.990907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1153/2276] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:03 2022] DELETE /identity/v3/users/1684e743d6384e0a9209a7510e3903a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:03.995368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:03.995871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:03.996475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:04.013973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:04.015371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:04.081839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1124/2277] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:04.098827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:04.109663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:04.200325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2aae-75ea-4bbe-986d-f703bb0c564e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:04.203915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:04.204615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:04.204910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:04.205188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:04.215538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:04.217110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:04.226857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1154/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:04.508066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:04.509823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:04.522283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078a5d8-90b5-4441-998f-702c83ad0e9a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:04.541100 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:04.543595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:04.544005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:04.544480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] PATH_INFO: `/v3/projects/2a73a7474c404cc1b79a92058de39d48` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:04.546208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a73a7474c404cc1b79a92058de39d48)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:04.557044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:04.632931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a73a7474c404cc1b79a92058de39d48', 'request_id': 'req-8e185688-0583-46e1-a948-4f3ceddca4c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.642113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a73a7474c404cc1b79a92058de39d48', 'request_id': 'req-8e185688-0583-46e1-a948-4f3ceddca4c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.648942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a73a7474c404cc1b79a92058de39d48', 'request_id': 'req-8e185688-0583-46e1-a948-4f3ceddca4c6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.660534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] The token cache is being invalidate because project 2a73a7474c404cc1b79a92058de39d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:04.660845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.661494 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.663307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1125/2279] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:04 2022] DELETE /identity/v3/projects/2a73a7474c404cc1b79a92058de39d48 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:04.667003 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:04.676965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a42ea-1a1b-4211-958c-ab0192e2286d service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:04.735791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:04.736692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:04.736995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:04.737268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] PATH_INFO: `/v3/users/e5ade793eeca4acb9bbd7a683928f920` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:04.738577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ade793eeca4acb9bbd7a683928f920)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:04.740567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:04.785859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ade793eeca4acb9bbd7a683928f920'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.797753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ade793eeca4acb9bbd7a683928f920'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.804983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ade793eeca4acb9bbd7a683928f920'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.805733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ade793eeca4acb9bbd7a683928f920'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.812537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a9e1982-658f-41f9-8bab-3092b013cf50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ade793eeca4acb9bbd7a683928f920'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:04.818524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1155/2280] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:04 2022] DELETE /identity/v3/users/e5ade793eeca4acb9bbd7a683928f920 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:05.116476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:05.118806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:05.134979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185688-0583-46e1-a948-4f3ceddca4c6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:05.202065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:05.203054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:05.203499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:05.203849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] PATH_INFO: `/v3/projects/2edd74785954441ea77c01eae4d04b41` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:05.205334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edd74785954441ea77c01eae4d04b41)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:05.207448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:05.300796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edd74785954441ea77c01eae4d04b41', 'request_id': 'req-bef93e26-f4b5-458b-b567-0514fe51c71f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:05.314472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edd74785954441ea77c01eae4d04b41', 'request_id': 'req-bef93e26-f4b5-458b-b567-0514fe51c71f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:05.324885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edd74785954441ea77c01eae4d04b41', 'request_id': 'req-bef93e26-f4b5-458b-b567-0514fe51c71f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:05.337988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] The token cache is being invalidate because project 2edd74785954441ea77c01eae4d04b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:05.338457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:05.340537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bef93e26-f4b5-458b-b567-0514fe51c71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:05.345640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1126/2281] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:05 2022] DELETE /identity/v3/projects/2edd74785954441ea77c01eae4d04b41 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:08.190361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:08.190877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:08.190962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:08.210658 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] MFA Rules not processed for user `4f23070cd3fc48a9be463b1bc50ecf38`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:08.211925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:08.276331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1156/2282] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:11.543607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:11.544069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:11.544175 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:11.617140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:11.619472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:11.737605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1127/2283] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:11.785188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:11.787404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:11.938912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ca802-2647-441c-8560-c9c5647a8545 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:11.944741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b64eb3-cc78-4031-b8ea-6a0476e1520f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:11.945404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b64eb3-cc78-4031-b8ea-6a0476e1520f service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:11.945735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b64eb3-cc78-4031-b8ea-6a0476e1520f service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:11.946014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b64eb3-cc78-4031-b8ea-6a0476e1520f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:11.956575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b64eb3-cc78-4031-b8ea-6a0476e1520f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:11.958850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b64eb3-cc78-4031-b8ea-6a0476e1520f service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:11.968666 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1157/2284] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:11:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:11:16.728932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:16.730980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:16.796699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6868-c46e-4ed4-828c-b9be31afa1c3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:16.803227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:16.804325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:16.804737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:16.805033 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] PATH_INFO: `/v3/users/f77dc56f8e224e7c9a6c772bb9206da7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:16.806566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77dc56f8e224e7c9a6c772bb9206da7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:16.808837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:16.859761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77dc56f8e224e7c9a6c772bb9206da7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:16.871637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77dc56f8e224e7c9a6c772bb9206da7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:16.872510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77dc56f8e224e7c9a6c772bb9206da7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:16.883618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77dc56f8e224e7c9a6c772bb9206da7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:16.903168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77dc56f8e224e7c9a6c772bb9206da7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:16.913423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1128/2285] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:16 2022] DELETE /identity/v3/users/f77dc56f8e224e7c9a6c772bb9206da7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:16.918714 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:16.919240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:16.919341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:16.936888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:16.938136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:16.994847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1158/2286] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:17.004395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:17.005866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:17.061955 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6823e-1d5e-499e-8070-0d52027afe40 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:17.065443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1a9cc-709e-487f-b96c-c352a5bb22ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:17.066104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a9cc-709e-487f-b96c-c352a5bb22ea service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:17.066392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a9cc-709e-487f-b96c-c352a5bb22ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:17.066653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a9cc-709e-487f-b96c-c352a5bb22ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:17.077967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1a9cc-709e-487f-b96c-c352a5bb22ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:17.079390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1a9cc-709e-487f-b96c-c352a5bb22ea service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:17.088649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1129/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:17.457898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:17.459336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:17.477149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcfe75-6c2b-4390-af3b-1eb3ceb5c896 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:17.483730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:17.484834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:17.485297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:17.486570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] PATH_INFO: `/v3/projects/c2bf40efd5c24ecc9604857f587c5806` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:17.488577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2bf40efd5c24ecc9604857f587c5806)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:17.492107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:17.545781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bf40efd5c24ecc9604857f587c5806', 'request_id': 'req-7ec38c85-97c5-41c8-a477-734690b1042f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:17.556535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bf40efd5c24ecc9604857f587c5806', 'request_id': 'req-7ec38c85-97c5-41c8-a477-734690b1042f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:17.572580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bf40efd5c24ecc9604857f587c5806', 'request_id': 'req-7ec38c85-97c5-41c8-a477-734690b1042f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:17.591196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] The token cache is being invalidate because project c2bf40efd5c24ecc9604857f587c5806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:17.591499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:17.592167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7ec38c85-97c5-41c8-a477-734690b1042f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:17.593927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1159/2288] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:17 2022] DELETE /identity/v3/projects/c2bf40efd5c24ecc9604857f587c5806 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:17.598896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:17.599203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:17.599479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:17.630804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:17.632780 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:17.720599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1130/2289] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:17.728247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:17.728964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:17.729409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:17.750637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:17.766372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:17.786047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1160/2290] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:17.786932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:17.797387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6752525-4289-43cc-84a6-b85a8444bb2a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:17.802862 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:17.803845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:17.804349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:17.804840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:17.806064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:11:17.806596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:17.808570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:17.827778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:17.832485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1131/2291] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:11:17.838566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3bdc-fcfd-4619-97af-002e49187b1c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:17.846596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:17.847554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:17.848173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:17.848682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:17.849593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:17.852535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:17.892908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1161/2292] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:11:17 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:17.893442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:17.924299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f934b05-e287-449c-aa04-01c0ea81fd54 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:18.016677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:18.017732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:18.018244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:18.019378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:18.020515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:18.022525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:18.055742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:18.057196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1132/2293] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:17 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:11:18.079887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c42ea-c8d6-4c09-972a-53c0120af414 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:18.086245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:18.087027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:18.087377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:18.087875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:18.088993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:18.091306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:18.122546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1162/2294] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:11:18.126655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:18.140313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5531-cc39-43d8-95ee-e41b703f938c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:18.145943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb6169-eeab-4661-9b96-b993806e2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:18.146628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6169-eeab-4661-9b96-b993806e2146 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:18.146914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6169-eeab-4661-9b96-b993806e2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:18.147190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6169-eeab-4661-9b96-b993806e2146 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:18.148029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb6169-eeab-4661-9b96-b993806e2146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:18.150255 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb6169-eeab-4661-9b96-b993806e2146 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:18.163552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1133/2295] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:18.168524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:18.193741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e04dd7-ea19-402a-a8b6-1ed5eb7850c8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:18.207994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:18.209851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:18.210244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:18.210665 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] PATH_INFO: `/v3/projects/cfd703e9dd3e460d992ef2daab104619/users/516432654a024122987075db3f43798f/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:18.239464 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd703e9dd3e460d992ef2daab104619, user_id=516432654a024122987075db3f43798f, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:18.243517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:18.265438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1163/2296] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:18 2022] PUT /identity/v3/projects/cfd703e9dd3e460d992ef2daab104619/users/516432654a024122987075db3f43798f/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:18.270559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b14f-c90a-4c0b-ac17-02607ae0a0e1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:18.270850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b14f-c90a-4c0b-ac17-02607ae0a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:18.271141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b14f-c90a-4c0b-ac17-02607ae0a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:18.288926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-db18b14f-c90a-4c0b-ac17-02607ae0a0e1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:18.290377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-db18b14f-c90a-4c0b-ac17-02607ae0a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:18.388288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1134/2297] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:18.399201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:18.401233 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:18.496082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e5c5-0f69-42f6-8d44-b22cd48a231b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:18.500704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:18.501875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:18.502393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:18.503224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:18.516149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:18.519324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:18.535558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1164/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:26.086994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.087940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.088512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.184988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] MFA Rules not processed for user `516432654a024122987075db3f43798f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:26.187854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:26.300803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1135/2299] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:26.301136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:26.314473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971951-2678-429e-9a8d-e3e8af076dba service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:26.320137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:26.321062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.321509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.321989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.322869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:26.324973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:26.367249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:26.377922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1165/2300] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:11:26 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:11:26.382305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857a6b1-def0-4086-905d-9f2bdc957343 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:26.494193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:26.494924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.495214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.495489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.496223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:26.498716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:26.533346 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:26.543638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1136/2301] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:26 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:11:26.548583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b8b8-ef2a-44f0-b3d1-00855e8a38b9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:26.553845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:26.554986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.555444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.555880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.556966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:26.558975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:26.575831 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:26.587135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1166/2302] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:26.588342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36ddd-6bcd-4f3e-9995-dd658aafca78 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:26.603756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:26.604723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.605093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.605439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] PATH_INFO: `/v3/projects/601b87adc4a2466a841a8b1b58a898d5/users/63e35f4f1d724c31ac8c5e380263af26/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.642394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] RBAC: Authorizing `identity:create_grant(project_id=601b87adc4a2466a841a8b1b58a898d5, user_id=63e35f4f1d724c31ac8c5e380263af26, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:26.645432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:26.676032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:26.676719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1137/2303] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:26 2022] PUT /identity/v3/projects/601b87adc4a2466a841a8b1b58a898d5/users/63e35f4f1d724c31ac8c5e380263af26/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:26.693168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbcea1-8618-4e50-a52b-aa680786588c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:26.777370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1529ba-264a-4890-a0e9-e363c2db95ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:26.778232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1529ba-264a-4890-a0e9-e363c2db95ed admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.778648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1529ba-264a-4890-a0e9-e363c2db95ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.779087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1529ba-264a-4890-a0e9-e363c2db95ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.780093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1529ba-264a-4890-a0e9-e363c2db95ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:26.782817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1529ba-264a-4890-a0e9-e363c2db95ed admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:26.794742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1167/2304] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:26.798981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:26.810926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218465d5-4221-434b-b292-1eaf2c4a521c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:26.816671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:26.817747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:26.818109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:26.818463 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] PATH_INFO: `/v3/projects/601b87adc4a2466a841a8b1b58a898d5/users/63e35f4f1d724c31ac8c5e380263af26/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:26.820676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601b87adc4a2466a841a8b1b58a898d5, user_id=63e35f4f1d724c31ac8c5e380263af26, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:26.824197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:26.841524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1138/2305] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:26 2022] PUT /identity/v3/projects/601b87adc4a2466a841a8b1b58a898d5/users/63e35f4f1d724c31ac8c5e380263af26/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:35.305185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacc905-6ecb-4783-9406-80132922a6aa None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:35.306494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacc905-6ecb-4783-9406-80132922a6aa None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:35.306494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacc905-6ecb-4783-9406-80132922a6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:35.342086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4eacc905-6ecb-4783-9406-80132922a6aa None None] MFA Rules not processed for user `63e35f4f1d724c31ac8c5e380263af26`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:35.343324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4eacc905-6ecb-4783-9406-80132922a6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:35.440926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1168/2306] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:35.451467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:35.453851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:35.589094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e974bc-b3c3-4802-b2ba-0a2a02bbf9a6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:35.594909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:35.595579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:35.595865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:35.596149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:35.675593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:35.679187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:35.694517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1139/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:39.296130 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbc231-e1c3-4873-beb1-43c762f10046 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:39.296667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbc231-e1c3-4873-beb1-43c762f10046 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:39.296667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbc231-e1c3-4873-beb1-43c762f10046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:39.315053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e1fbc231-e1c3-4873-beb1-43c762f10046 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:39.316297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e1fbc231-e1c3-4873-beb1-43c762f10046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:39.379470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1169/2308] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:39.394054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:39.396099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:39.505677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399133-c397-44d7-bb20-eb364df497b9 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:39.512390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:39.513306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:39.513783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:39.514068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:39.524487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:39.526916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:39.547243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1140/2309] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 14:11:50.328236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:50.328763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:50.328884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:50.347067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:50.348253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:50.355364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1170/2310] 10.222.0.20 () {58 vars in 967 bytes} [Thu Apr 28 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:50.367875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:50.378140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789910-a7c2-4f5a-b146-63d2de17c80f service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:50.383286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:50.383919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:50.384789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:50.384999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:50.393089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:50.394697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:50.403495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1141/2311] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:11:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:11:52.621506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:52.624654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:52.696188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa7b98-93ec-4432-b1a5-1db077aebce6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:52.702340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:52.703209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:52.703491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:52.703786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] PATH_INFO: `/v3/users/59470153a65143c58b0a9ea79956622e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:52.704952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=59470153a65143c58b0a9ea79956622e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:52.706924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:52.755294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59470153a65143c58b0a9ea79956622e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:52.767387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59470153a65143c58b0a9ea79956622e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:52.776268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59470153a65143c58b0a9ea79956622e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:52.777042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59470153a65143c58b0a9ea79956622e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:52.784566 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-49b86282-4eb6-4905-8ff8-e6e67ab4fa8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59470153a65143c58b0a9ea79956622e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:52.792035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1171/2312] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:52 2022] DELETE /identity/v3/users/59470153a65143c58b0a9ea79956622e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:52.958190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:52.969617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eeed5-ce9d-440b-9491-3b6fa708bc90 service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.029145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.030021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.030300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.030573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] PATH_INFO: `/v3/projects/9f0d56bfaa63437f9fd46764d5659862` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.031997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0d56bfaa63437f9fd46764d5659862)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.033911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.076833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0d56bfaa63437f9fd46764d5659862', 'request_id': 'req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:53.085150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0d56bfaa63437f9fd46764d5659862', 'request_id': 'req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:53.091710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0d56bfaa63437f9fd46764d5659862', 'request_id': 'req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:53.102285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] The token cache is being invalidate because project 9f0d56bfaa63437f9fd46764d5659862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:11:53.102722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:53.103653 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1fd0b7c8-e3ca-448a-86d0-3a6dfa332cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:53.105610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1142/2313] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:11:52 2022] DELETE /identity/v3/projects/9f0d56bfaa63437f9fd46764d5659862 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:53.110341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.110632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.110981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.130564 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:53.131885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:53.197141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1172/2314] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:53.199147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.199433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.199713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.217724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:53.218913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:53.227002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1143/2315] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:53.230938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.240866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec77fc-4151-4adb-bea6-5fa3166b8320 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.246214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.246597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.246932 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.247131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.247850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:11:53.248152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.249764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.261358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1173/2316] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:11:53.265547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.275535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70766-22a7-4298-8618-5fef25f57623 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.280282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.281193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.281474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.281786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.282485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.284378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.313067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1144/2317] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:11:53 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:53.314433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.324500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397939-061c-4aa6-be2f-8126f3c3f2ca admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.384123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.385006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.385291 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.385580 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.386276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.388445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.412565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1174/2318] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:11:53 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:11:53.413797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.424056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea71a94-7ad3-42d8-936b-f4efe05fa88b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.429152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.429860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.430115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.430406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.431856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.433337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.444698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1145/2319] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:53.448875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.459674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe599-2d4d-4ca0-a2a2-3c40ac9ba496 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.464845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790eecc-b064-47ad-a70e-c8a986826b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.465741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790eecc-b064-47ad-a70e-c8a986826b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.466074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790eecc-b064-47ad-a70e-c8a986826b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.466353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790eecc-b064-47ad-a70e-c8a986826b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.467082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790eecc-b064-47ad-a70e-c8a986826b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.468915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790eecc-b064-47ad-a70e-c8a986826b1b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.480605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1175/2320] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:11:53.484461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.495845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ecda-0b4e-4d41-b4db-13da37f072be admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.501334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.502390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.502854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.503108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] PATH_INFO: `/v3/projects/41237bb81ade44018b1ef1781e00db45/users/400f5f9cb30d4cd380913684bc0bb6ff/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.519536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41237bb81ade44018b1ef1781e00db45, user_id=400f5f9cb30d4cd380913684bc0bb6ff, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.522647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.536459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1146/2321] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:11:53 2022] PUT /identity/v3/projects/41237bb81ade44018b1ef1781e00db45/users/400f5f9cb30d4cd380913684bc0bb6ff/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:53.542618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffe82-0fe0-4d16-9f2b-3acaca8f0672 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.543023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffe82-0fe0-4d16-9f2b-3acaca8f0672 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.543374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffe82-0fe0-4d16-9f2b-3acaca8f0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.561621 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f3fffe82-0fe0-4d16-9f2b-3acaca8f0672 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:53.563158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f3fffe82-0fe0-4d16-9f2b-3acaca8f0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:53.625271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1176/2322] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:53.635047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.637066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:53.705451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c059c23-f3b5-4d9c-8911-dfce9fc3ae8a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:53.708967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f84c-1f41-4f10-b66c-839d7fb896e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:53.709722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f84c-1f41-4f10-b66c-839d7fb896e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.710114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f84c-1f41-4f10-b66c-839d7fb896e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.710457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f84c-1f41-4f10-b66c-839d7fb896e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.724284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95f84c-1f41-4f10-b66c-839d7fb896e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:53.725897 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95f84c-1f41-4f10-b66c-839d7fb896e0 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:53.736324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1147/2323] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:53.810085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446db63-d8d1-4ce3-b71b-e9d2a164de17 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.810376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446db63-d8d1-4ce3-b71b-e9d2a164de17 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.810647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446db63-d8d1-4ce3-b71b-e9d2a164de17 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.812026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1177/2324] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:11:53.819103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4359d-f05c-4abe-873a-204c8698199b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:53.819866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4359d-f05c-4abe-873a-204c8698199b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:53.820164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4359d-f05c-4abe-873a-204c8698199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:53.857740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-54e4359d-f05c-4abe-873a-204c8698199b None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:53.858942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-54e4359d-f05c-4abe-873a-204c8698199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:53.927717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1148/2325] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:53.940039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446db63-d8d1-4ce3-b71b-e9d2a164de17 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:53.941991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8446db63-d8d1-4ce3-b71b-e9d2a164de17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:54.026839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446db63-d8d1-4ce3-b71b-e9d2a164de17 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:54.030679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca3259-2ee5-49e4-bbb1-58f0dc0c7350 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:54.031709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca3259-2ee5-49e4-bbb1-58f0dc0c7350 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.031996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca3259-2ee5-49e4-bbb1-58f0dc0c7350 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.032413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca3259-2ee5-49e4-bbb1-58f0dc0c7350 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.044160 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca3259-2ee5-49e4-bbb1-58f0dc0c7350 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:54.045632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca3259-2ee5-49e4-bbb1-58f0dc0c7350 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:54.058200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1178/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:11:54.144332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1debc9-c5df-46ea-9e3c-61ae3bb21a98 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.145131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1debc9-c5df-46ea-9e3c-61ae3bb21a98 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.145650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1debc9-c5df-46ea-9e3c-61ae3bb21a98 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.147234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1149/2327] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:11:54.153465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b7bc7-fa64-4c38-99e6-923bde3385a3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.153960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b7bc7-fa64-4c38-99e6-923bde3385a3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.154413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b7bc7-fa64-4c38-99e6-923bde3385a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.180020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dc3b7bc7-fa64-4c38-99e6-923bde3385a3 None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:54.181183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc3b7bc7-fa64-4c38-99e6-923bde3385a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:54.188536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1179/2328] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:11:54.201948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1debc9-c5df-46ea-9e3c-61ae3bb21a98 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:54.216454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1debc9-c5df-46ea-9e3c-61ae3bb21a98 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:54.222267 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d860bee-5af4-45a0-a427-f3baf18834bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:54.225708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860bee-5af4-45a0-a427-f3baf18834bc service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.226259 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860bee-5af4-45a0-a427-f3baf18834bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.227097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860bee-5af4-45a0-a427-f3baf18834bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.235708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d860bee-5af4-45a0-a427-f3baf18834bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:54.237375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d860bee-5af4-45a0-a427-f3baf18834bc service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:54.246439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1150/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:54.346266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5ada-2fa2-470b-b5bf-fe7219c4ac97 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.346567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5ada-2fa2-470b-b5bf-fe7219c4ac97 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.347283 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5ada-2fa2-470b-b5bf-fe7219c4ac97 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.348661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1180/2330] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:11:54.353929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3a20-7c4e-4a15-9185-6656a17806e5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.354281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3a20-7c4e-4a15-9185-6656a17806e5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.354621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3a20-7c4e-4a15-9185-6656a17806e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.373982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-abdc3a20-7c4e-4a15-9185-6656a17806e5 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:54.375312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-abdc3a20-7c4e-4a15-9185-6656a17806e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:54.387179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1151/2331] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:11:54.397982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5ada-2fa2-470b-b5bf-fe7219c4ac97 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:54.412389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5ada-2fa2-470b-b5bf-fe7219c4ac97 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:54.419344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed87f-5925-4800-b2c3-8e84ba3e7a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:54.420251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed87f-5925-4800-b2c3-8e84ba3e7a4a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:54.420869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed87f-5925-4800-b2c3-8e84ba3e7a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:54.421275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed87f-5925-4800-b2c3-8e84ba3e7a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:54.433271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed87f-5925-4800-b2c3-8e84ba3e7a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:54.435341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed87f-5925-4800-b2c3-8e84ba3e7a4a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:54.448736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1181/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:11:55.931156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:55.931718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:55.931718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:55.958704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] MFA Rules not processed for user `516432654a024122987075db3f43798f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:55.960001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:56.039470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1152/2333] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:11:58.050454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:58.051501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:58.051798 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:58.072622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:58.074556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:58.165744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1182/2334] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:58.180214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:58.183493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:58.267788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b40bdb-0572-4867-8c3a-5c64dea4f868 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:58.275163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8b3f5-103b-4a96-818d-4453d8fa5db8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:58.276269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8b3f5-103b-4a96-818d-4453d8fa5db8 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:58.276718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8b3f5-103b-4a96-818d-4453d8fa5db8 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:58.277150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8b3f5-103b-4a96-818d-4453d8fa5db8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:58.287992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8b3f5-103b-4a96-818d-4453d8fa5db8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:58.290236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8b3f5-103b-4a96-818d-4453d8fa5db8 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:58.315537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1153/2335] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:11:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:11:59.299049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:59.300645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:59.346838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a7aa-b51a-4e94-810e-afc0334cfead None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:59.365042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:59.366050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:59.366256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:59.366538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] PATH_INFO: `/v3/users/bb3586c6f035424582907d705d905acb` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:59.378570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3586c6f035424582907d705d905acb)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:59.380904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:59.508556 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3586c6f035424582907d705d905acb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:59.537501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3586c6f035424582907d705d905acb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:59.552096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3586c6f035424582907d705d905acb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:59.553073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3586c6f035424582907d705d905acb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:59.563692 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3586c6f035424582907d705d905acb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:11:59.579450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1183/2336] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:11:59 2022] DELETE /identity/v3/users/bb3586c6f035424582907d705d905acb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:11:59.584260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f209d43-9ff9-46f0-a504-156fca595c59 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:59.584703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f209d43-9ff9-46f0-a504-156fca595c59 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:59.584801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f209d43-9ff9-46f0-a504-156fca595c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:59.636193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6f209d43-9ff9-46f0-a504-156fca595c59 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:11:59.637426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6f209d43-9ff9-46f0-a504-156fca595c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:59.785373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1154/2337] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:11:59.793211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:11:59.794867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:11:59.863780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a62fe-d5e8-40cf-a31e-ded6a1908eed admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:11:59.876107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:11:59.877399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:11:59.877399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:11:59.877812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:11:59.920104 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:11:59.921792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:11:59.956699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1184/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:00.447566 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:00.448196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:00.448730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:00.481705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] MFA Rules not processed for user `400f5f9cb30d4cd380913684bc0bb6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:00.482994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:00.556526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1155/2339] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:00.561854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:00.564426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:00.587646 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c6c9-c9e0-4099-9ea3-8bec6ebf095f service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:00.594271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:00.595322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:00.595818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:00.596237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:00.597910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:00.600456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:00.645918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1185/2340] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:12:00 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:12:00.650174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:00.674684 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3fab7-c84a-4b06-bba3-b7dd7403300f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:00.760729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:00.762677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:00.816245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:00.817299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:00.818635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:00.819066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:00.819944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:00.822802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:00.884782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1156/2341] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:12:00 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:12:00.886230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:00.907572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca5e9-1fa1-436a-ba41-2d31278328ca admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:00.907928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a32f-d8ba-4d5b-b850-c07fac700d19 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:00.918830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:00.919750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:00.920121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:00.920881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:00.920979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] PATH_INFO: `/v3/projects/76213c7ca86e43ae835a3ca6a13220df` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:00.921056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:00.921524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:00.921801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:00.922518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:00.924355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:00.927725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=76213c7ca86e43ae835a3ca6a13220df)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:00.929847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:00.939245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1157/2342] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:00.940223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:00.950854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7da3-51b2-47cd-aac8-dba39cb7bbd3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:00.956632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:00.957939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:00.958224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:00.958505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] PATH_INFO: `/v3/projects/24b376b48e6945ab85ce319896d4a296/users/d2e7836ed9dc41908debe0760f49685f/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:00.979551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b376b48e6945ab85ce319896d4a296, user_id=d2e7836ed9dc41908debe0760f49685f, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:00.982604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.004833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1158/2343] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:12:00 2022] PUT /identity/v3/projects/24b376b48e6945ab85ce319896d4a296/users/d2e7836ed9dc41908debe0760f49685f/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:12:01.010578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.010763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76213c7ca86e43ae835a3ca6a13220df', 'request_id': 'req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:01.022400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76213c7ca86e43ae835a3ca6a13220df', 'request_id': 'req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:01.032177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76213c7ca86e43ae835a3ca6a13220df', 'request_id': 'req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:01.044429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] The token cache is being invalidate because project 76213c7ca86e43ae835a3ca6a13220df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:12:01.044719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:01.045630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04ccf7aa-1bae-4509-9929-ee03b1dd1ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:01.047249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1186/2344] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:12:00 2022] DELETE /identity/v3/projects/76213c7ca86e43ae835a3ca6a13220df => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:12:01.058922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f934-ec05-424a-8d59-13a2dea6059a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.059278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f934-ec05-424a-8d59-13a2dea6059a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.059753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f934-ec05-424a-8d59-13a2dea6059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.082886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5a20f934-ec05-424a-8d59-13a2dea6059a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:01.086092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5a20f934-ec05-424a-8d59-13a2dea6059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:01.142817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a902e5-7045-43bd-99e0-1b25a30529c4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.148158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.148842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.149206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.149516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.150300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.151911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.165609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1159/2345] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:01.167620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.169890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:01.234486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad068d-73fc-411e-bad2-a8a952224255 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.239488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1187/2346] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:12:01.240222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.241240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.241702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.242084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] PATH_INFO: `/v3/projects/24b376b48e6945ab85ce319896d4a296/users/d2e7836ed9dc41908debe0760f49685f/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.245257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.245420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b376b48e6945ab85ce319896d4a296, user_id=d2e7836ed9dc41908debe0760f49685f, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.245701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.246795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.247965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.271604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1160/2347] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:12:01 2022] PUT /identity/v3/projects/24b376b48e6945ab85ce319896d4a296/users/d2e7836ed9dc41908debe0760f49685f/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:12:01.280954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:01.282567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:01.375592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1188/2348] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:01.379824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.398902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b590-cd83-44fe-8bb7-b9a1db842fc1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.414022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.415482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.415947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.416829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.417776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:12:01.421332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.424942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.472236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1161/2349] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:12:01.476602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.489425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5026ff-b59b-4c67-8f56-bc4a97e2ee2b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.495175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.499777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.499777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.499777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.499777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.499777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.534709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1189/2350] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:12:01 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:12:01.536358 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.565238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f491b8e-e41c-4174-a20e-32014efafc85 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.669030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.670763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.671204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.671765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.673335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.676268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.710804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1162/2351] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:12:01 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:12:01.715541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.741905 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76b5c4-f747-440b-a4c5-26d14a584639 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.761036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.762017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.762469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.762921 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.763970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.765830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.787682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1190/2352] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:01.791691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.804110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392be37-2e3c-478e-bd85-fe2df4a53fe8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.815810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38727-d719-42b2-923a-93aee38041d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.816889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38727-d719-42b2-923a-93aee38041d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.817495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38727-d719-42b2-923a-93aee38041d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.817849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38727-d719-42b2-923a-93aee38041d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.818845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e38727-d719-42b2-923a-93aee38041d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.822586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e38727-d719-42b2-923a-93aee38041d3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.846957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1163/2353] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:01.858229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:01.878597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175870fd-43a5-43b3-8061-10f9d1cf402b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:01.884641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:01.885637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.885985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.886378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] PATH_INFO: `/v3/projects/fec3a7bc54264a76b5e73321661a9d11/users/b1df032511ec4b518cd614e156321b9d/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:01.914418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec3a7bc54264a76b5e73321661a9d11, user_id=b1df032511ec4b518cd614e156321b9d, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:01.917797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:01.961803 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1191/2354] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:12:01 2022] PUT /identity/v3/projects/fec3a7bc54264a76b5e73321661a9d11/users/b1df032511ec4b518cd614e156321b9d/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:12:01.979980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769079a-e17c-48f1-9136-4e054d16806f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:01.980273 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769079a-e17c-48f1-9136-4e054d16806f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:01.980562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769079a-e17c-48f1-9136-4e054d16806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:02.057458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0769079a-e17c-48f1-9136-4e054d16806f None None] MFA Rules not processed for user `b1df032511ec4b518cd614e156321b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:02.058687 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0769079a-e17c-48f1-9136-4e054d16806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:02.230946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1164/2355] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:02.248250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:02.250093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:02.373423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1902a-9e45-4c08-8bd6-20553d9d3789 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:02.383695 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614ac7-7ec4-4a2b-bffd-18cb4945b1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:02.383929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614ac7-7ec4-4a2b-bffd-18cb4945b1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:02.384225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614ac7-7ec4-4a2b-bffd-18cb4945b1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:02.384770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614ac7-7ec4-4a2b-bffd-18cb4945b1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:02.396735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0614ac7-7ec4-4a2b-bffd-18cb4945b1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:02.398440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0614ac7-7ec4-4a2b-bffd-18cb4945b1c3 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:02.410784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1192/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:04.086475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:04.087003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:04.087108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:04.131600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] MFA Rules not processed for user `b1df032511ec4b518cd614e156321b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:04.133062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:04.153229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1165/2357] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:09.807341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbc365-e1bb-494e-b8ac-86bc3d662a70 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:09.807883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbc365-e1bb-494e-b8ac-86bc3d662a70 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:09.808249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbc365-e1bb-494e-b8ac-86bc3d662a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:09.851939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-96dbc365-e1bb-494e-b8ac-86bc3d662a70 None None] MFA Rules not processed for user `d2e7836ed9dc41908debe0760f49685f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:09.853396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-96dbc365-e1bb-494e-b8ac-86bc3d662a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:09.936401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1193/2358] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:09.947061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:09.948489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:10.037476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5868d-ac3f-4112-bcd5-9c063373ce9b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:10.046123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:10.046926 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:10.047268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:10.047610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:10.050510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:10.120832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:10.122705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7510f7-56be-4c67-8f18-bd61c137cd6b service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:10.134250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1166/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:12.966441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:12.967386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:12.967837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:12.993272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] MFA Rules not processed for user `400f5f9cb30d4cd380913684bc0bb6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:12.994822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:13.019050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1194/2360] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:25.303110 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:25.304140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:25.304499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:25.325847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:25.327166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:25.384898 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1167/2361] 10.222.0.20 () {58 vars in 967 bytes} [Thu Apr 28 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:25.407193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:25.408655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:25.476636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cc7d9-157e-4e87-a9e6-5b98314bfc17 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:25.481727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbd813-1833-4a20-b7c2-9f65a076d3d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:25.482377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd813-1833-4a20-b7c2-9f65a076d3d3 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:25.482661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd813-1833-4a20-b7c2-9f65a076d3d3 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:25.482937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd813-1833-4a20-b7c2-9f65a076d3d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:25.491153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd813-1833-4a20-b7c2-9f65a076d3d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:25.493345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd813-1833-4a20-b7c2-9f65a076d3d3 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:25.501198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1195/2362] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:12:26.479097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:26.480490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:26.535303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be26db7-d23c-461c-83cb-bf060820d3cd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:26.539072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:26.539713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:26.539992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:26.540263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:26.542118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:26.603426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:26.604863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:26.617766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1168/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:27.989679 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1463fda-2d90-41c2-bd11-a5a1d981fa89 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:27.990156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1463fda-2d90-41c2-bd11-a5a1d981fa89 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:27.990261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1463fda-2d90-41c2-bd11-a5a1d981fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:28.008542 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f1463fda-2d90-41c2-bd11-a5a1d981fa89 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:28.009478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f1463fda-2d90-41c2-bd11-a5a1d981fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:28.017282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1196/2364] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:28.031415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:28.042238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778227eb-e999-4e36-94e1-791e1a518dfc service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:28.047099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:28.047733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:28.048280 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:28.048716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:28.056562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:28.058200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:28.066060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1169/2365] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:12:28.608994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f542ef0-059f-459d-881e-280f1193cf50 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:28.609350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f542ef0-059f-459d-881e-280f1193cf50 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:28.609726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f542ef0-059f-459d-881e-280f1193cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:28.628874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7f542ef0-059f-459d-881e-280f1193cf50 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:28.630300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7f542ef0-059f-459d-881e-280f1193cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:28.638506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1197/2366] 10.222.0.20 () {58 vars in 967 bytes} [Thu Apr 28 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:28.652334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:28.663879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3669-4bdd-4bb6-ab61-3be05e9b4e2a service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:28.669158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:28.669916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:28.670270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:28.670631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:28.680002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:28.682091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:28.690614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1170/2367] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:12:28.897430 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0aa96-3219-4935-886d-63c487e034b7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:28.897828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0aa96-3219-4935-886d-63c487e034b7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:28.898182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0aa96-3219-4935-886d-63c487e034b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:28.920099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ecb0aa96-3219-4935-886d-63c487e034b7 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:28.921321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ecb0aa96-3219-4935-886d-63c487e034b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:28.929673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1198/2368] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:12:28.943756 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:28.954623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488526c-7524-4439-a18c-e2cf5d48e361 service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:28.960197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:28.960868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:28.961204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:28.961477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:28.969990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:28.971760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:28.980626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1171/2369] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 14:12:29.343069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:29.343600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:29.343600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:29.362625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:29.364259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:29.378258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1199/2370] 10.222.0.20 () {58 vars in 967 bytes} [Thu Apr 28 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:29.385455 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:29.396041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c302d-20f1-47db-9609-5ef4b11f7b4f service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:29.401539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008e937-0e15-44e4-b012-7581ee3d10bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:29.402198 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008e937-0e15-44e4-b012-7581ee3d10bf service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:29.402476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008e937-0e15-44e4-b012-7581ee3d10bf service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:29.402749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008e937-0e15-44e4-b012-7581ee3d10bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:29.410833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008e937-0e15-44e4-b012-7581ee3d10bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:29.412396 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008e937-0e15-44e4-b012-7581ee3d10bf service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:29.420838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1172/2371] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:12:31.474066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:31.542947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39dce-631b-429e-b086-7b17f2521a86 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:31.556268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:31.557122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:31.557418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:31.557793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] PATH_INFO: `/v3/users/b1df032511ec4b518cd614e156321b9d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:31.559126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1df032511ec4b518cd614e156321b9d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:31.561090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:31.605935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1df032511ec4b518cd614e156321b9d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:31.616812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1df032511ec4b518cd614e156321b9d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:31.623470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1df032511ec4b518cd614e156321b9d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:31.624071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1df032511ec4b518cd614e156321b9d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:31.630650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1df032511ec4b518cd614e156321b9d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:31.636548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1200/2372] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:12:31 2022] DELETE /identity/v3/users/b1df032511ec4b518cd614e156321b9d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:12:31.640931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:31.641395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:31.641490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:31.660053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:31.661266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:31.718972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1173/2373] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:31.730045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:31.731833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:31.789048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff325-d8a0-45d8-abcc-586dfff68150 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:31.792724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833d8ba-c72d-4b21-be1d-9bdea67c9754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:31.793366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833d8ba-c72d-4b21-be1d-9bdea67c9754 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:31.793685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833d8ba-c72d-4b21-be1d-9bdea67c9754 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:31.793964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833d8ba-c72d-4b21-be1d-9bdea67c9754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:31.802753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833d8ba-c72d-4b21-be1d-9bdea67c9754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:31.804348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833d8ba-c72d-4b21-be1d-9bdea67c9754 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:31.813549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1201/2374] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:31.977045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:31.978605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:31.991580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df73f4-9060-40e7-9d49-e8fb71fd71cb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:31.996752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:31.997971 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:31.998334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:31.998626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] PATH_INFO: `/v3/projects/fec3a7bc54264a76b5e73321661a9d11` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:31.999834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec3a7bc54264a76b5e73321661a9d11)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.001896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.049254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec3a7bc54264a76b5e73321661a9d11', 'request_id': 'req-19ece259-8138-45eb-89a3-212d700eb6b5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:32.056600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec3a7bc54264a76b5e73321661a9d11', 'request_id': 'req-19ece259-8138-45eb-89a3-212d700eb6b5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:32.063133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec3a7bc54264a76b5e73321661a9d11', 'request_id': 'req-19ece259-8138-45eb-89a3-212d700eb6b5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:32.073916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] The token cache is being invalidate because project fec3a7bc54264a76b5e73321661a9d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:12:32.074203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:32.074847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-19ece259-8138-45eb-89a3-212d700eb6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:12:32.077078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1174/2375] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:12:31 2022] DELETE /identity/v3/projects/fec3a7bc54264a76b5e73321661a9d11 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:12:32.081819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.082194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.082608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.102861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:32.104295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:32.166057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1202/2376] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:32.174847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169763-98e1-47aa-973b-f46891fa197a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.175278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169763-98e1-47aa-973b-f46891fa197a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.175465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169763-98e1-47aa-973b-f46891fa197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.195662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-83169763-98e1-47aa-973b-f46891fa197a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:32.196868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-83169763-98e1-47aa-973b-f46891fa197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:32.205065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1175/2377] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:32.210886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.222079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4378-4d04-468f-b7f2-11c127218dae None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.227202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.227717 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.228425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.228523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.229297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:12:32.229642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.231385 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.245327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1203/2378] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:12:32.249019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83169763-98e1-47aa-973b-f46891fa197a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.261361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83169763-98e1-47aa-973b-f46891fa197a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.266237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.267458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.267458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.267458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.268249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.270615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.301203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1176/2379] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:12:32 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:12:32.305863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.318345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a33c-35ed-4d57-b5e9-3f4795f61217 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.375780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.376457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.376742 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.377043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.377760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.379755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.400222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1204/2380] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:12:32 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:12:32.404348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.414769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b7e2f-603a-4bb0-857b-78ac5d395789 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.419398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.420126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.420496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.420901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.421732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.423322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.434439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1177/2381] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:32.494792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.505008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cfc90-b302-4ee6-a7e6-d307c65c0140 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.510493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352404a3-2377-4c09-b659-46a87b976852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.511164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352404a3-2377-4c09-b659-46a87b976852 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.511445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352404a3-2377-4c09-b659-46a87b976852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.511718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352404a3-2377-4c09-b659-46a87b976852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.512445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352404a3-2377-4c09-b659-46a87b976852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.514105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352404a3-2377-4c09-b659-46a87b976852 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.524707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1205/2382] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:32.529064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.542290 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db98e-6565-4945-8b45-545ba41793aa admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.547213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.548068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.548352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.548628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] PATH_INFO: `/v3/projects/8ca7572c7d93469fb8bfe911e1ad93f4/users/c7470b9fb6dc42cfb86bb596c0da8b2f/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.563196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca7572c7d93469fb8bfe911e1ad93f4, user_id=c7470b9fb6dc42cfb86bb596c0da8b2f, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.565891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.584660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1178/2383] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:12:32 2022] PUT /identity/v3/projects/8ca7572c7d93469fb8bfe911e1ad93f4/users/c7470b9fb6dc42cfb86bb596c0da8b2f/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:12:32.590748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945710c0-da17-4f2b-b2fb-ad6893342062 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.591726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945710c0-da17-4f2b-b2fb-ad6893342062 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.592151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945710c0-da17-4f2b-b2fb-ad6893342062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.617490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-945710c0-da17-4f2b-b2fb-ad6893342062 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:32.619283 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-945710c0-da17-4f2b-b2fb-ad6893342062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:32.694793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1206/2384] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:12:32.712686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:32.716240 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:32.794391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5b365-a5b3-4cdf-aa0f-94b8bd9f9bbe admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:32.798553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:32.799411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:32.799858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:32.800141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:32.810289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:32.811733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:32.822249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1179/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:37.683215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:37.683729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:37.683927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:37.718615 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] MFA Rules not processed for user `c7470b9fb6dc42cfb86bb596c0da8b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:37.719831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:37.785737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1207/2386] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:37.790770 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:37.801936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ac88-b13c-44a0-b523-f23718fba9ce service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:37.808278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:37.808772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:37.809055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:37.809324 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:37.810042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:37.811944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:37.837527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1180/2387] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:12:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:12:37.841647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:37.853398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52003b4f-b1e5-44e0-90e4-a7577c2807e3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:37.917027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:37.919707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:37.920938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:37.921225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:37.921973 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:37.924777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:37.949755 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1208/2388] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:12:37 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:12:37.953412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:37.964667 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541786-6b75-4867-872d-6e9cb405d6eb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:37.977058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:37.977779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:37.978300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:37.978585 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:37.979319 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:37.980981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:37.992636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1181/2389] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:37.996897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:38.007074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf9594-7ae3-4300-9413-f16829124e0a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:38.011979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:38.012868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:38.013156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:38.013428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] PATH_INFO: `/v3/projects/25898ab687f4414b8193cfeafe495cb9/users/7e6e01c6a59f4cd39a49678e55d9b601/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:38.031087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25898ab687f4414b8193cfeafe495cb9, user_id=7e6e01c6a59f4cd39a49678e55d9b601, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:38.033840 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:38.047878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1209/2390] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:12:37 2022] PUT /identity/v3/projects/25898ab687f4414b8193cfeafe495cb9/users/7e6e01c6a59f4cd39a49678e55d9b601/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:12:38.051762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:38.062091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33dcb-99ea-4995-9534-993aa24ff187 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:38.128177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444072f-f0ce-45d9-a0c7-75f5ca67d45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:38.128927 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444072f-f0ce-45d9-a0c7-75f5ca67d45d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:38.129392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444072f-f0ce-45d9-a0c7-75f5ca67d45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:38.129863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444072f-f0ce-45d9-a0c7-75f5ca67d45d admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:38.130434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444072f-f0ce-45d9-a0c7-75f5ca67d45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:38.132103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444072f-f0ce-45d9-a0c7-75f5ca67d45d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:38.142372 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1182/2391] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:12:38.146175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:38.157213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d1280-03d5-4f67-b904-e739d1135313 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:38.162045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:38.163515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:38.163790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:38.164061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] PATH_INFO: `/v3/projects/25898ab687f4414b8193cfeafe495cb9/users/7e6e01c6a59f4cd39a49678e55d9b601/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:38.166051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25898ab687f4414b8193cfeafe495cb9, user_id=7e6e01c6a59f4cd39a49678e55d9b601, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:38.168672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:38.178970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1210/2392] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:12:38 2022] PUT /identity/v3/projects/25898ab687f4414b8193cfeafe495cb9/users/7e6e01c6a59f4cd39a49678e55d9b601/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:12:43.824824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38f4b8-a5b5-4b06-9c8f-68868e750453 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:43.825364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38f4b8-a5b5-4b06-9c8f-68868e750453 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:43.825364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38f4b8-a5b5-4b06-9c8f-68868e750453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:43.859782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ec38f4b8-a5b5-4b06-9c8f-68868e750453 None None] MFA Rules not processed for user `7e6e01c6a59f4cd39a49678e55d9b601`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:43.861127 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ec38f4b8-a5b5-4b06-9c8f-68868e750453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:43.958889 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1183/2393] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:43.973611 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:43.976302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:44.041661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e89c-2245-438b-99d8-0ce1ca8585f4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:44.045455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:44.046137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:44.046418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:44.046690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:44.104709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:44.106237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:44.115071 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1211/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:12:44.208092 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c7b7-55ea-4545-b91e-0a656153acaf None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:44.208386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c7b7-55ea-4545-b91e-0a656153acaf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:44.208666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c7b7-55ea-4545-b91e-0a656153acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:44.231002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-98c8c7b7-55ea-4545-b91e-0a656153acaf None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:44.232252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-98c8c7b7-55ea-4545-b91e-0a656153acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:44.295972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1184/2395] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:44.310142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:44.311656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:44.398739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50338751-c5a7-4a61-93b2-17bf0a8d60cf service glance] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:44.403994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:44.404900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:44.405184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:44.405460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:44.415395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:44.417194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:44.425397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1212/2396] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:12:45.630654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d5573-4227-42d2-bd69-0bdeff0cefb2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:45.631683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d5573-4227-42d2-bd69-0bdeff0cefb2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:45.631801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d5573-4227-42d2-bd69-0bdeff0cefb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:45.656123 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a00d5573-4227-42d2-bd69-0bdeff0cefb2 None None] MFA Rules not processed for user `4f23070cd3fc48a9be463b1bc50ecf38`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:45.657767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a00d5573-4227-42d2-bd69-0bdeff0cefb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:45.740313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1185/2397] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:48.270956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:48.273848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:48.344192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af760-a49b-4cef-a44d-cb7524bd0109 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:48.357400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:48.358212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:48.358616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:48.358965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:48.360875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:48.451568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:48.453029 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd3504-85aa-43fb-8e3a-aee3c72e6e0d service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:48.476397 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1213/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:12:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:12:55.437053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:55.437774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:55.437774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:55.455660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] MFA Rules not processed for user `c7470b9fb6dc42cfb86bb596c0da8b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:55.456869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:55.464363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1186/2399] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:57.519148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642bad-9a83-41ae-87ef-239feec08165 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:57.519649 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642bad-9a83-41ae-87ef-239feec08165 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:57.519877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642bad-9a83-41ae-87ef-239feec08165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:57.542138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e7642bad-9a83-41ae-87ef-239feec08165 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:12:57.543504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e7642bad-9a83-41ae-87ef-239feec08165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:12:57.553655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1214/2400] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:12:57.566829 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:12:57.581816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea82e-7b13-4b0f-bae5-fa0ebe9c4fd2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:12:57.588287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:12:57.589171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:12:57.589670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:12:57.589960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:12:57.600629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:12:57.602282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:12:57.611122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1187/2401] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:12:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:13:24.593668 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:24.594227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:24.594227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:24.612014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] MFA Rules not processed for user `59ae8544d37b4de78c4164fc9de7acb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:13:24.613189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:13:24.666885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1215/2402] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:13:28.485140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:28.496891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7f16-02a4-4c40-916e-2926e23fac12 service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:28.502712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:28.504595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:28.505281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:28.505804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:28.521917 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:28.525798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:28.537524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1188/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:13:57.560726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:57.562479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:13:57.634910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260a6f2-2f7f-4bd1-9741-b1ae32748ebe None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:57.639410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:57.640261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:57.640538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:57.640809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] PATH_INFO: `/v3/users/4f23070cd3fc48a9be463b1bc50ecf38` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:57.642017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f23070cd3fc48a9be463b1bc50ecf38)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:57.643911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:57.686890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f23070cd3fc48a9be463b1bc50ecf38'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:57.698511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f23070cd3fc48a9be463b1bc50ecf38'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:57.705364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f23070cd3fc48a9be463b1bc50ecf38'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:57.706099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f23070cd3fc48a9be463b1bc50ecf38'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:57.712654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b3ad45da-5aa2-4c1a-87cc-33d292952e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f23070cd3fc48a9be463b1bc50ecf38'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:57.718384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1216/2404] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:13:57 2022] DELETE /identity/v3/users/4f23070cd3fc48a9be463b1bc50ecf38 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:13:57.888672 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:57.905293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d2a42-65a1-4fa2-a88f-19aa166b5cf0 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:57.960553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:57.961406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:57.961717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:57.961993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] PATH_INFO: `/v3/projects/56f9e0563ca841b2acf0475664032b9f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:57.963193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f9e0563ca841b2acf0475664032b9f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:57.965086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.008833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f9e0563ca841b2acf0475664032b9f', 'request_id': 'req-2297d072-ed1d-4815-b398-c427faf6a615'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:58.015743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f9e0563ca841b2acf0475664032b9f', 'request_id': 'req-2297d072-ed1d-4815-b398-c427faf6a615'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:58.021674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f9e0563ca841b2acf0475664032b9f', 'request_id': 'req-2297d072-ed1d-4815-b398-c427faf6a615'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:58.031920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] The token cache is being invalidate because project 56f9e0563ca841b2acf0475664032b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:13:58.032200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:58.032824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2297d072-ed1d-4815-b398-c427faf6a615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:13:58.034400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1189/2405] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:13:57 2022] DELETE /identity/v3/projects/56f9e0563ca841b2acf0475664032b9f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:13:58.039410 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.039763 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.040126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.058912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:13:58.060094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:13:58.116815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1217/2406] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:13:58.125002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.125292 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.125600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.143522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:13:58.144717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:13:58.152491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1190/2407] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:13:58.156789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.167257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbecc20-3333-489e-9438-24832cfb169d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.171981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.172634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.172912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.173184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.173944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:13:58.174281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.175875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.187979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1218/2408] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:13:58.192299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.201515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93545959-e6aa-486e-9c6d-a4f34802fd94 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.206374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.207018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.207296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.207570 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.208276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.210220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.236323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1191/2409] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:13:58.240005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.250825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac09bc-ab0a-4154-b845-54ff1dfd6570 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.308221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.308887 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.309166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.309440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.310166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.312069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.331610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1219/2410] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:13:58 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:13:58.335666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.348217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90397942-7897-4909-a71a-f1d44ba22b96 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.353828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.354501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.354785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.355063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.355796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.357401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.370681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1192/2411] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:13:58.371915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.381663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6358f6-65f3-4188-8da3-a48f4a3ae99a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.386265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a219-6ea2-4b93-8b53-90e115bdfe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.386909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a219-6ea2-4b93-8b53-90e115bdfe88 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.387188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a219-6ea2-4b93-8b53-90e115bdfe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.387461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a219-6ea2-4b93-8b53-90e115bdfe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.388177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a219-6ea2-4b93-8b53-90e115bdfe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.389778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a219-6ea2-4b93-8b53-90e115bdfe88 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.402113 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1220/2412] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:13:58.406502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.416790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97362c0-3255-43c8-8ab2-8d34a77979da admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.421398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.422318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.422598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.422882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] PATH_INFO: `/v3/projects/9bc2618a240d4702b6c7660829fabbcd/users/5a07a92c35e84b0084c2a96263897e92/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.437334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc2618a240d4702b6c7660829fabbcd, user_id=5a07a92c35e84b0084c2a96263897e92, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.440137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.453626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1193/2413] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:13:58 2022] PUT /identity/v3/projects/9bc2618a240d4702b6c7660829fabbcd/users/5a07a92c35e84b0084c2a96263897e92/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:13:58.458784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cfcc2-14a3-4bb0-b542-c69162438cc1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.459140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cfcc2-14a3-4bb0-b542-c69162438cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.459482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cfcc2-14a3-4bb0-b542-c69162438cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.476558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-883cfcc2-14a3-4bb0-b542-c69162438cc1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:13:58.477966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-883cfcc2-14a3-4bb0-b542-c69162438cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:13:58.534265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1221/2414] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:13:58.545065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:13:58.546777 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:13:58.612192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c247c65-c463-497f-b5c6-7a44a388468e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:13:58.616049 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:13:58.617134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:13:58.617134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:13:58.617490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:13:58.627277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:13:58.628840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:13:58.639195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1194/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:04.080990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a0af-908f-4978-b35d-7178a95c189a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:04.081458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a0af-908f-4978-b35d-7178a95c189a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:04.081608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a0af-908f-4978-b35d-7178a95c189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:04.121110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b329a0af-908f-4978-b35d-7178a95c189a None None] MFA Rules not processed for user `5a07a92c35e84b0084c2a96263897e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:04.122688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b329a0af-908f-4978-b35d-7178a95c189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:04.195320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1222/2416] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:14:04.209912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:04.211849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:04.265908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:04.266335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:04.266689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:04.284898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] MFA Rules not processed for user `e724e0c0897b4ac1975a3ba7d1d741f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:04.286860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:04.304836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f22e6b-fd4c-4e94-822a-666e9c2ec53c service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:04.311357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347f10-05be-462e-bb91-218370a1eba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:04.312380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347f10-05be-462e-bb91-218370a1eba1 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:04.312380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347f10-05be-462e-bb91-218370a1eba1 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:04.312608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347f10-05be-462e-bb91-218370a1eba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:04.324753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347f10-05be-462e-bb91-218370a1eba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:04.326403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347f10-05be-462e-bb91-218370a1eba1 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:04.336340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1195/2417] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:14:04.345735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1223/2418] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:14:06.238347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:06.239390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:06.239840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:06.278447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] MFA Rules not processed for user `5a07a92c35e84b0084c2a96263897e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:06.280008 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:06.297296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1196/2419] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:14:15.528053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:15.529469 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:15.541764 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b00fa-3cfd-46f0-8721-e1f47f7ebe90 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:15.545236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:15.545909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:15.546189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:15.546459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:15.548513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:15.562472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:15.563892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:15.575516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1224/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:16.695247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:16.704622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb11be-cd6e-4c3e-89e1-5bb8c86e854d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:16.708096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:16.708724 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:16.709003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:16.709277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:16.711144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:16.724177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:16.725618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:16.737141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1197/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:38.334857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:38.348151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac7b5-bb07-4133-bafc-dd7fd683dfcf service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:38.356547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:38.358323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:38.370197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:38.371166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:38.371449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:38.371726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:38.373796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:38.374869 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2dc23-6e7a-4a5d-80fc-cdc029ce3c98 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:38.389702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:38.390708 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:38.391225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:38.391683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:38.394288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:38.408451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:38.410245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadc0f4-6e17-4949-a6b1-cba28e15301f service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:38.429298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1198/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:38.458094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:38.459849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3dc42-df7a-4fee-ae87-90b97a02b435 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:38.472653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1225/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:40.202395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:40.202871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:40.202980 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:40.221820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] MFA Rules not processed for user `516432654a024122987075db3f43798f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:40.222081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:40.275124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1199/2424] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:14:40.547500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:40.547984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:40.548077 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:40.566223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:40.567417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:40.590547 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:40.599858 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d63540-2ae6-4be9-b24e-83aeae91d96f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:40.603553 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:40.604197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:40.604481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:40.604757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:40.606626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:40.616118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:40.617537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:40.622117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1226/2425] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:14:40.625527 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1200/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:14:40.665730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:40.667122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:40.740640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd5634-3767-4e21-a120-739f17284daf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:40.746234 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:40.746877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:40.747158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:40.747434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:40.755543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:40.757133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:40.765018 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1227/2427] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:14:41.140225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:41.144945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:41.234650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d6ea1-84bf-4378-bcd4-b67b744c3969 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:41.240726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:41.241438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:41.241758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:41.242623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:41.245281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:41.260450 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:41.262355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:41.272563 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1201/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:43.301383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:43.318891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c614a-f5c9-4276-966a-95d84a382330 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:43.328205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:43.329084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:43.329378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:43.329924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:43.338510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:43.350074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:43.354775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3145d8-0c15-4a7c-962c-05d73bcc59a2 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:43.381947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1228/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:55.420727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:55.430608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d657e-b1e0-4951-ac0b-e0f9c1a0b0b4 service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:55.434504 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:55.435345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.435821 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.436263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.438245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:55.449999 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:55.452162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:55.462407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1202/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:55.590107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0587-2f5f-49f4-8bde-09dbf78798fb None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.590706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0587-2f5f-49f4-8bde-09dbf78798fb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.590706 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0587-2f5f-49f4-8bde-09dbf78798fb None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.592227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1229/2431] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:14:55.592617 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:55.605223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3462-d5f3-4079-b112-eb519dab2285 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.605916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3462-d5f3-4079-b112-eb519dab2285 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.606455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3462-d5f3-4079-b112-eb519dab2285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.609270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f71ad-7d93-4398-8984-5053c99f1715 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:55.617934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:55.618884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.619355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.619740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.623002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:55.636014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:55.637988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:55.638108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ddac3462-d5f3-4079-b112-eb519dab2285 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:55.639441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ddac3462-d5f3-4079-b112-eb519dab2285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:55.649873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1203/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:14:55.661868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1230/2433] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:14:55.675782 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:55.677545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:55.773698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f813fc-a24b-42c4-b8c8-e1981dbd6d62 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:55.778160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04a76a-2ea2-4eec-b26c-3f800cf13702 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:55.778815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a76a-2ea2-4eec-b26c-3f800cf13702 service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.779170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a76a-2ea2-4eec-b26c-3f800cf13702 service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.779454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a76a-2ea2-4eec-b26c-3f800cf13702 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.794819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04a76a-2ea2-4eec-b26c-3f800cf13702 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:55.796045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04a76a-2ea2-4eec-b26c-3f800cf13702 service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:55.811792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1204/2434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:55.890259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da4ddc-a009-4816-9b15-6462c93d90f1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.890471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da4ddc-a009-4816-9b15-6462c93d90f1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.890873 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da4ddc-a009-4816-9b15-6462c93d90f1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.892601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1231/2435] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:14:55.898426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fed17-7c38-4168-b586-261237b561a2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.898713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fed17-7c38-4168-b586-261237b561a2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.899010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fed17-7c38-4168-b586-261237b561a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.921673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7b2fed17-7c38-4168-b586-261237b561a2 None None] MFA Rules not processed for user `049e46a723a24775a734834e57535201`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:55.923006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7b2fed17-7c38-4168-b586-261237b561a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:55.935002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1205/2436] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:14:55.943831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da4ddc-a009-4816-9b15-6462c93d90f1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:55.956054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da4ddc-a009-4816-9b15-6462c93d90f1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:55.959592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19b323-f198-4f24-8d0f-668d207aabce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:55.960836 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19b323-f198-4f24-8d0f-668d207aabce service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:55.961120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19b323-f198-4f24-8d0f-668d207aabce service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:55.961407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19b323-f198-4f24-8d0f-668d207aabce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:55.968509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19b323-f198-4f24-8d0f-668d207aabce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:55.969971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19b323-f198-4f24-8d0f-668d207aabce service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:55.977881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1232/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:14:56.079345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b986-67d5-4f3f-b69c-844fb1f70eb7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:56.079642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b986-67d5-4f3f-b69c-844fb1f70eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:56.079928 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b986-67d5-4f3f-b69c-844fb1f70eb7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:56.081315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1206/2438] 10.222.0.20 () {54 vars in 921 bytes} [Thu Apr 28 14:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 14:14:56.086813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:56.087203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:56.087508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:56.105298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] MFA Rules not processed for user `be883e9492f14daa856a2a9eba500bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:14:56.106545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:14:56.115929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1233/2439] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Apr 28 14:14:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:14:56.126983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b986-67d5-4f3f-b69c-844fb1f70eb7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:14:56.138317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b986-67d5-4f3f-b69c-844fb1f70eb7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:14:56.142072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dda34b-03f1-4866-b2a6-4aa880e21e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:14:56.142658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda34b-03f1-4866-b2a6-4aa880e21e23 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:14:56.143058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda34b-03f1-4866-b2a6-4aa880e21e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:14:56.143338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda34b-03f1-4866-b2a6-4aa880e21e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:14:56.154064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dda34b-03f1-4866-b2a6-4aa880e21e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:14:56.155427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dda34b-03f1-4866-b2a6-4aa880e21e23 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:14:56.166068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1207/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:00.357866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:00.369773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6d77-5d7f-46c9-84ea-e63ff5db60e8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:00.376379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:00.377399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:00.377777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:00.378124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:00.380423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:00.395184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:00.396892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:00.410064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1234/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:01.223018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344b2c-7f6f-403a-8fca-9e5c0ae259fc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:01.223840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344b2c-7f6f-403a-8fca-9e5c0ae259fc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:01.223840 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344b2c-7f6f-403a-8fca-9e5c0ae259fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:01.244409 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8e344b2c-7f6f-403a-8fca-9e5c0ae259fc None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:01.245826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8e344b2c-7f6f-403a-8fca-9e5c0ae259fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:01.255226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1208/2442] 10.222.0.20 () {58 vars in 967 bytes} [Thu Apr 28 14:15:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:01.270774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:01.285149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64eea0-9c12-47d1-8903-b07678f96785 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:01.297519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:01.298450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:01.298942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:01.299219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:01.324425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:01.326059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:01.335450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1235/2443] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:15:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:15:02.005810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:02.006183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:02.006555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:02.029503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:02.031125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:02.041832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1209/2444] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Apr 28 14:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:02.055863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:02.066698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1772d7-f362-4ac5-b383-a55ce0d215fd service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:02.072828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:02.073451 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:02.073881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:02.074214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:02.083863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:02.086270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:02.096100 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1236/2445] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:15:03.365639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:03.393195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ef87-bd1d-4e82-b457-55246f03c922 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:03.399646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:03.400359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:03.400622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:03.400899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:03.402952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:03.426241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:03.428211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:03.440323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1210/2446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:10.444219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:10.445894 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:10.470966 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03156c-7633-4020-9057-206f15497c73 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:10.484064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:10.484957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:10.485239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:10.485515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] PATH_INFO: `/v3/users/c7470b9fb6dc42cfb86bb596c0da8b2f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:10.486901 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7470b9fb6dc42cfb86bb596c0da8b2f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:10.489102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:10.544137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7470b9fb6dc42cfb86bb596c0da8b2f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.556205 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7470b9fb6dc42cfb86bb596c0da8b2f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.564654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7470b9fb6dc42cfb86bb596c0da8b2f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.565435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7470b9fb6dc42cfb86bb596c0da8b2f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.574352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7470b9fb6dc42cfb86bb596c0da8b2f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.581317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1237/2447] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:10 2022] DELETE /identity/v3/users/c7470b9fb6dc42cfb86bb596c0da8b2f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:10.789351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:10.808416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805431e-f890-46e5-91c3-7dba7016c7b0 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:10.874459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:10.875492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:10.875968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:10.876412 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] PATH_INFO: `/v3/projects/8ca7572c7d93469fb8bfe911e1ad93f4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:10.877961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca7572c7d93469fb8bfe911e1ad93f4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:10.880252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:10.933289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca7572c7d93469fb8bfe911e1ad93f4', 'request_id': 'req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.942339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca7572c7d93469fb8bfe911e1ad93f4', 'request_id': 'req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.949337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca7572c7d93469fb8bfe911e1ad93f4', 'request_id': 'req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.959059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] The token cache is being invalidate because project 8ca7572c7d93469fb8bfe911e1ad93f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:10.959908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.960533 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:10.962111 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1211/2448] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:10 2022] DELETE /identity/v3/projects/8ca7572c7d93469fb8bfe911e1ad93f4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:10.966272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:10.967920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:10.982163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b304e-0ca4-464f-8c7d-33c5169878f6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:11.039624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:11.040548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:11.040832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:11.041109 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] PATH_INFO: `/v3/users/7e6e01c6a59f4cd39a49678e55d9b601` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:11.042356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6e01c6a59f4cd39a49678e55d9b601)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:11.044368 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:11.090031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6e01c6a59f4cd39a49678e55d9b601'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.102813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6e01c6a59f4cd39a49678e55d9b601'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.110348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6e01c6a59f4cd39a49678e55d9b601'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.111011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6e01c6a59f4cd39a49678e55d9b601'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.118288 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-515fe4e0-7079-4c0c-99af-ff280078cf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6e01c6a59f4cd39a49678e55d9b601'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.124074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1238/2449] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:10 2022] DELETE /identity/v3/users/7e6e01c6a59f4cd39a49678e55d9b601 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:11.295498 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:11.296907 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:11.309952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b5c7-94c8-4b90-a878-e0f2a6bcd983 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:11.367125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:11.367994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:11.368271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:11.368541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] PATH_INFO: `/v3/projects/25898ab687f4414b8193cfeafe495cb9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:11.369796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25898ab687f4414b8193cfeafe495cb9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:11.371753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:11.416817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25898ab687f4414b8193cfeafe495cb9', 'request_id': 'req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.424606 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25898ab687f4414b8193cfeafe495cb9', 'request_id': 'req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.431179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25898ab687f4414b8193cfeafe495cb9', 'request_id': 'req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.441083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] The token cache is being invalidate because project 25898ab687f4414b8193cfeafe495cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:11.441368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.442052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:11.443662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1212/2450] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:11 2022] DELETE /identity/v3/projects/25898ab687f4414b8193cfeafe495cb9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:19.675746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ede181-2038-4afd-9ac3-f5aeb64e6272 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:19.676269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ede181-2038-4afd-9ac3-f5aeb64e6272 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:19.676383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ede181-2038-4afd-9ac3-f5aeb64e6272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:19.694791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b2ede181-2038-4afd-9ac3-f5aeb64e6272 None None] MFA Rules not processed for user `c8489bced3994d299e7edc9af7b1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:19.697689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b2ede181-2038-4afd-9ac3-f5aeb64e6272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:19.761537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1239/2451] 10.222.0.20 () {58 vars in 967 bytes} [Thu Apr 28 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:19.773790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:19.775214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:19.842222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce494b4-cc35-4af8-91c0-8b8f4e8dc4a7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:19.847106 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69ab30e4eb4a46945a5420d85ec611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:19.847745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:19.848031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:19.848313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:19.856679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:19.858293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:19.866957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1213/2452] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Apr 28 14:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 14:15:29.612328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:29.612850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:29.612953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:29.630891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] MFA Rules not processed for user `5a07a92c35e84b0084c2a96263897e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:29.632158 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:29.685282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1240/2453] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:48.420187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:48.421633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:48.478279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544c57b-01bb-4de1-bb5a-8f75bea3c812 service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:48.482140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:48.482790 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:48.483073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:48.483351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:48.485119 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:48.546619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:48.548050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:48.559410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1214/2454] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:51.776426 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:51.779440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:51.800102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d82cc-bdd1-4403-be6b-be0409ed1595 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:51.806088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:51.806911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:51.807189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:51.807459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] PATH_INFO: `/v3/users/e724e0c0897b4ac1975a3ba7d1d741f8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:51.808655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e724e0c0897b4ac1975a3ba7d1d741f8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:51.810982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:51.868157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e724e0c0897b4ac1975a3ba7d1d741f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:51.883486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e724e0c0897b4ac1975a3ba7d1d741f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:51.891554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e724e0c0897b4ac1975a3ba7d1d741f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:51.892367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e724e0c0897b4ac1975a3ba7d1d741f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:51.900494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7cb965c1-48ab-437f-a80e-c696ee70e203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e724e0c0897b4ac1975a3ba7d1d741f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:51.906872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1241/2455] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:51 2022] DELETE /identity/v3/users/e724e0c0897b4ac1975a3ba7d1d741f8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:52.081027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.091460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aab226-ea90-4590-866f-cf80a7ec83e8 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.149384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.150516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.150817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.151085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] PATH_INFO: `/v3/projects/4af9f146066048418277f36db15f3f65` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.152383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af9f146066048418277f36db15f3f65)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.154303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.200446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af9f146066048418277f36db15f3f65', 'request_id': 'req-6a82c471-9960-4f2c-9152-3529c339f6af'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:52.207688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af9f146066048418277f36db15f3f65', 'request_id': 'req-6a82c471-9960-4f2c-9152-3529c339f6af'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:52.214540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af9f146066048418277f36db15f3f65', 'request_id': 'req-6a82c471-9960-4f2c-9152-3529c339f6af'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:52.224382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] The token cache is being invalidate because project 4af9f146066048418277f36db15f3f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:52.224660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:52.225885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6a82c471-9960-4f2c-9152-3529c339f6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:52.227407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1215/2456] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:52 2022] DELETE /identity/v3/projects/4af9f146066048418277f36db15f3f65 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:52.232482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.232772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.233052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.250614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:52.251857 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:52.310137 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1242/2457] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:52.318434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.318855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.318855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.341596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:52.342707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:52.352156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1216/2458] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:52.356587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.366361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f2a3f-fc4e-4f93-9c70-74b204f206b9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.371062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.371723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.372006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.372279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.372993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:15:52.373299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.374927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.386240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1243/2459] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:15:52.390473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.400270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c7a39-b7c3-488e-81b7-f07c907707b3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.404894 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.405541 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.405860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.406139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.406835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.408740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.442710 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1217/2460] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:52.446899 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.456597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff4e29-950f-4dbb-9d51-41138ba2b85c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.510577 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.511243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.511524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.511807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.512495 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.514485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.538844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1244/2461] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/users => generated 281 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:15:52.540742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.551062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b206-78b8-4636-8321-60293528704c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.555778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.556444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.556743 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.557021 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.557906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.559514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.570281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1218/2462] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:52.574652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.585480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4889f-f670-4856-89e7-0c97b3e78220 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.590320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf0e0-78a0-45e5-b328-cf5e213c631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.590981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf0e0-78a0-45e5-b328-cf5e213c631f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.591264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf0e0-78a0-45e5-b328-cf5e213c631f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.591867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf0e0-78a0-45e5-b328-cf5e213c631f admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.592459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf0e0-78a0-45e5-b328-cf5e213c631f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.594103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf0e0-78a0-45e5-b328-cf5e213c631f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.604246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1245/2463] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:52.608558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.619034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb917f73-01b4-4fd5-9fdb-d0aeb4371354 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.623805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.624689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.625062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.625338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] PATH_INFO: `/v3/projects/3a6db6870db549d2ba18fc3ed9ddc6e9/users/de514f8359314a11b9e4e90ac014fef7/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.644734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6db6870db549d2ba18fc3ed9ddc6e9, user_id=de514f8359314a11b9e4e90ac014fef7, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.648878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.663395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1219/2464] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:52 2022] PUT /identity/v3/projects/3a6db6870db549d2ba18fc3ed9ddc6e9/users/de514f8359314a11b9e4e90ac014fef7/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:52.673774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.674084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.674383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.703254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] MFA Rules not processed for user `de514f8359314a11b9e4e90ac014fef7`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:52.704458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:52.770318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1246/2465] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:52.775723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.840816 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ce837-dd74-4519-9fcf-067c18c7c8d7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.845577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.846235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.846515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.846788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.847509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.849435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.873972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1220/2466] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:52.877964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.890013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64145f47-a7e8-4bd2-97e3-aed8ae8f2f3f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:52.955694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:52.956405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:52.956845 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:52.957126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:52.957876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:52.960025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:52.980996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1247/2467] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:15:52 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:52.984594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:52.996180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f26a6-3046-4ebd-8db6-4fc44cf664ec admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:53.000896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:53.001590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.001880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.002158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.002888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:53.004491 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:53.016874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1221/2468] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:53.021123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:53.031575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2b93e-20db-46e7-93d6-480d0d281c5e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:53.036120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:53.037020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.037325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.037575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] PATH_INFO: `/v3/projects/859f6fb70307495aa7a755167d8ff25f/users/c4bb0313a1d745df8a12a6719159e642/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.051967 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] RBAC: Authorizing `identity:create_grant(project_id=859f6fb70307495aa7a755167d8ff25f, user_id=c4bb0313a1d745df8a12a6719159e642, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:53.055417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:53.068863 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1248/2469] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:53 2022] PUT /identity/v3/projects/859f6fb70307495aa7a755167d8ff25f/users/c4bb0313a1d745df8a12a6719159e642/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:15:53.073081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:53.083805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11828684-f0c9-4409-aea0-3c0244219dcc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:53.141713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105c0b9-5ad2-4e19-9cde-69b8eaa906dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:53.142380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c0b9-5ad2-4e19-9cde-69b8eaa906dc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.142660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c0b9-5ad2-4e19-9cde-69b8eaa906dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.142935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c0b9-5ad2-4e19-9cde-69b8eaa906dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.143669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c0b9-5ad2-4e19-9cde-69b8eaa906dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:53.145233 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c0b9-5ad2-4e19-9cde-69b8eaa906dc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:53.154967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1222/2470] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:53.159202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:53.169413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ecd7-1371-4645-8b1f-0b5daf0379de admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:53.173965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:53.174831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.175108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.175380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] PATH_INFO: `/v3/projects/859f6fb70307495aa7a755167d8ff25f/users/c4bb0313a1d745df8a12a6719159e642/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.178028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859f6fb70307495aa7a755167d8ff25f, user_id=c4bb0313a1d745df8a12a6719159e642, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:53.180771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:53.190825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1249/2471] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:53 2022] PUT /identity/v3/projects/859f6fb70307495aa7a755167d8ff25f/users/c4bb0313a1d745df8a12a6719159e642/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:53.202865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.203142 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.203418 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.230262 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] MFA Rules not processed for user `c4bb0313a1d745df8a12a6719159e642`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:53.231457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:53.298995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1223/2472] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:53.310589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:53.312295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:53.370063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaecf4b-1c89-4fcb-ac21-e8d463f3ae66 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:53.373581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4e84-3316-4a86-ac4f-e1174ecf9f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:53.374225 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4e84-3316-4a86-ac4f-e1174ecf9f43 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.374501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4e84-3316-4a86-ac4f-e1174ecf9f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.374772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4e84-3316-4a86-ac4f-e1174ecf9f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.384371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c4e84-3316-4a86-ac4f-e1174ecf9f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:53.385816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c4e84-3316-4a86-ac4f-e1174ecf9f43 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:53.395078 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1250/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:53.809702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:53.874914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79978e63-6d78-49f3-a322-bd06e3b2ab90 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:53.879277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:53.880151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.882555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.882555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] PATH_INFO: `/v3/users/de514f8359314a11b9e4e90ac014fef7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.883005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de514f8359314a11b9e4e90ac014fef7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:53.884752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:53.935204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de514f8359314a11b9e4e90ac014fef7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:53.947371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de514f8359314a11b9e4e90ac014fef7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:53.948065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de514f8359314a11b9e4e90ac014fef7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:53.954628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de514f8359314a11b9e4e90ac014fef7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:53.961688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de514f8359314a11b9e4e90ac014fef7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:53.967510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1224/2474] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:53 2022] DELETE /identity/v3/users/de514f8359314a11b9e4e90ac014fef7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:53.972006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:53.972510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:53.972622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:53.991818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:53.993041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:54.055970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1251/2475] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:54.066788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:54.068745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:54.135268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f27f5-b5f1-409f-afaa-317e9f31f537 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:54.139082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:54.139722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:54.140000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:54.140270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:54.152310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:54.153835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:54.164513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1225/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:54.456648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:54.458640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:54.484006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f4860-8725-4fa5-b1c7-e2657d713ba8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:54.494195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:54.495212 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:54.495583 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:54.495954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] PATH_INFO: `/v3/projects/3a6db6870db549d2ba18fc3ed9ddc6e9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:54.497537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6db6870db549d2ba18fc3ed9ddc6e9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:54.500329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:54.556700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6db6870db549d2ba18fc3ed9ddc6e9', 'request_id': 'req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.567790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6db6870db549d2ba18fc3ed9ddc6e9', 'request_id': 'req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.575997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6db6870db549d2ba18fc3ed9ddc6e9', 'request_id': 'req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.590196 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] The token cache is being invalidate because project 3a6db6870db549d2ba18fc3ed9ddc6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:54.590478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.591203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.592756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1252/2477] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:54 2022] DELETE /identity/v3/projects/3a6db6870db549d2ba18fc3ed9ddc6e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:54.597244 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:54.608717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100294e-9f33-48ec-83b5-bb20ace2c220 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:54.684378 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:54.685178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:54.685464 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:54.685768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] PATH_INFO: `/v3/users/c4bb0313a1d745df8a12a6719159e642` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:54.687020 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4bb0313a1d745df8a12a6719159e642)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:54.688983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:54.739472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4bb0313a1d745df8a12a6719159e642'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.755016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4bb0313a1d745df8a12a6719159e642'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.756027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4bb0313a1d745df8a12a6719159e642'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.764149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4bb0313a1d745df8a12a6719159e642'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.776530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-821ca79b-5971-4262-ad5e-1f80e81766f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4bb0313a1d745df8a12a6719159e642'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:54.785315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1226/2478] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:54 2022] DELETE /identity/v3/users/c4bb0313a1d745df8a12a6719159e642 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:55.097264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.097264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:55.111015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa91a2-9f72-4292-a5dc-e9de90a4f45b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.192249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.193683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.194005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.194476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] PATH_INFO: `/v3/projects/859f6fb70307495aa7a755167d8ff25f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.196761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=859f6fb70307495aa7a755167d8ff25f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.200285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.261893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859f6fb70307495aa7a755167d8ff25f', 'request_id': 'req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:55.273682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859f6fb70307495aa7a755167d8ff25f', 'request_id': 'req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:55.281603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859f6fb70307495aa7a755167d8ff25f', 'request_id': 'req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:55.294116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] The token cache is being invalidate because project 859f6fb70307495aa7a755167d8ff25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:55.294439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:55.295211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f9fff82e-5fbf-4eb3-ac38-755cef67b03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:55.296837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1253/2479] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:55 2022] DELETE /identity/v3/projects/859f6fb70307495aa7a755167d8ff25f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:55.301986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.303091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.303485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.323959 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:55.323959 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:55.394940 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1227/2480] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:55.403124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.403437 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.403713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.422148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:55.423365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:55.432300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1254/2481] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:55.437153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.448325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8c791-06a9-4c03-b6c1-ba5a8ebd1a27 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.453965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.455026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.455483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.455953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.457207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:15:55.457804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.460048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.472156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1228/2482] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:15:55.476715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.487333 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348570ed-ee55-4e21-af1f-10e207c1b282 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.492509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.493161 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.493442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.493745 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.494432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.496345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.523222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1255/2483] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:55.528855 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.539731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216fab-2a72-409f-9c89-ace67cdd0cb1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.597228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.597938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.598224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.598496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.599184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.601102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.620305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1229/2484] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:15:55.624582 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.636654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372215-9f3a-475d-afcb-9f03ca46bcfb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.644295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.644955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.645231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.645500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.646837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.648438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.659442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1256/2485] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:55.663689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.676532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc12b-6f15-404a-97d3-507da9281967 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.681276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324e078-c70a-4680-ac21-0c7a56fe3884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.681989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e078-c70a-4680-ac21-0c7a56fe3884 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.682252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e078-c70a-4680-ac21-0c7a56fe3884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.682525 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e078-c70a-4680-ac21-0c7a56fe3884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.683247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324e078-c70a-4680-ac21-0c7a56fe3884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.684874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324e078-c70a-4680-ac21-0c7a56fe3884 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.697094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1230/2486] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:55.701969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.713273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557a3a-0abb-43a2-8dd5-7aae2cad6ac4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.719155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.720548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.720832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.721166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] PATH_INFO: `/v3/projects/c2db657307b648658d8eb82d1f08238b/users/3533247fba004f7483016b7fafd2e917/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.737854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2db657307b648658d8eb82d1f08238b, user_id=3533247fba004f7483016b7fafd2e917, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.741834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.757241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1257/2487] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:55 2022] PUT /identity/v3/projects/c2db657307b648658d8eb82d1f08238b/users/3533247fba004f7483016b7fafd2e917/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:55.768860 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.769146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.769518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.797763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] MFA Rules not processed for user `3533247fba004f7483016b7fafd2e917`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:55.798992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:55.865853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1231/2488] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:55.870398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.946444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276abf9-41bc-44cf-95d7-af361dd7633b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:55.951935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:55.952713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:55.952892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:55.953172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:55.953914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:55.955823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:55.981482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1258/2489] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:55.985761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:55.997784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7f96-e4d2-44b6-b29f-3d9dd12269ec None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:56.062031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:56.062704 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.062987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.063263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.063951 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:56.065979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:56.088226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1232/2490] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:15:55 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:56.093143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:56.109290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6901-3ce5-465f-b74f-59e7625678c4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:56.114752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:56.115996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.116275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.116547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.117282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:56.118911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:56.129987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1259/2491] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:56.135661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:56.148263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943888-8d4c-4e62-b4cb-2cf1f05ed30e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:56.155818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:56.157375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.157846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.158177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] PATH_INFO: `/v3/projects/a56d88b3dfc5489abc3120c5766f6644/users/60b9cf5d064943149c40a66389064fbb/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.185024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56d88b3dfc5489abc3120c5766f6644, user_id=60b9cf5d064943149c40a66389064fbb, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:56.187890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:56.202923 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1233/2492] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:56 2022] PUT /identity/v3/projects/a56d88b3dfc5489abc3120c5766f6644/users/60b9cf5d064943149c40a66389064fbb/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:56.207342 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:56.218339 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bfff1-b852-4a80-a82f-06e7bb321058 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:56.281280 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bab83-bf8e-470e-a4e2-2a91e55c685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:56.282552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bab83-bf8e-470e-a4e2-2a91e55c685c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.282752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bab83-bf8e-470e-a4e2-2a91e55c685c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.282983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bab83-bf8e-470e-a4e2-2a91e55c685c admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.283796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bab83-bf8e-470e-a4e2-2a91e55c685c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:56.286299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bab83-bf8e-470e-a4e2-2a91e55c685c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:56.303443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1260/2493] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:56.308065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:56.318968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79395-a71e-493b-8c77-311b718e5e10 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:56.324350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:56.325355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.325662 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.325935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] PATH_INFO: `/v3/projects/a56d88b3dfc5489abc3120c5766f6644/users/60b9cf5d064943149c40a66389064fbb/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.327921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56d88b3dfc5489abc3120c5766f6644, user_id=60b9cf5d064943149c40a66389064fbb, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:56.330690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:56.342909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1234/2494] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:56 2022] PUT /identity/v3/projects/a56d88b3dfc5489abc3120c5766f6644/users/60b9cf5d064943149c40a66389064fbb/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:56.356474 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.356934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.357350 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.395382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] MFA Rules not processed for user `60b9cf5d064943149c40a66389064fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:56.396589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:56.478439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1261/2495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:56.491681 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:56.493931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:56.567076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5518d-249b-48e7-b0a0-6bbee8a82b1e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:56.570812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1a86a-86b6-4aba-b776-771adc473156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:56.571520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a86a-86b6-4aba-b776-771adc473156 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:56.571835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a86a-86b6-4aba-b776-771adc473156 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:56.572128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a86a-86b6-4aba-b776-771adc473156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:56.582152 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a86a-86b6-4aba-b776-771adc473156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:56.583534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a86a-86b6-4aba-b776-771adc473156 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:56.593649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1235/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:57.998524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:58.062461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f59bd1-dfdf-486d-b570-9518396cba46 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:58.068103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:58.068992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:58.069301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:58.069596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] PATH_INFO: `/v3/users/3533247fba004f7483016b7fafd2e917` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:58.071300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3533247fba004f7483016b7fafd2e917)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:58.073576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:58.121991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3533247fba004f7483016b7fafd2e917'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.134123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3533247fba004f7483016b7fafd2e917'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.141286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3533247fba004f7483016b7fafd2e917'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.141946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3533247fba004f7483016b7fafd2e917'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.149955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3533247fba004f7483016b7fafd2e917'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.155789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1262/2497] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:57 2022] DELETE /identity/v3/users/3533247fba004f7483016b7fafd2e917 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:58.160532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:58.161005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:58.161159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:58.179562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:58.180788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:58.248078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1236/2498] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:58.257880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:58.259311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:58.316300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a618d35-4f95-4210-8f96-4b344338366e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:58.320359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:58.321019 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:58.321301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:58.321618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:58.331189 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:58.332630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:58.343433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1263/2499] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:15:58.619995 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:58.621431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:58.637295 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe794b-f51f-4f6d-ad6b-84a2f141a857 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:58.643090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:58.643985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:58.644266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:58.644792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] PATH_INFO: `/v3/projects/c2db657307b648658d8eb82d1f08238b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:58.646649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2db657307b648658d8eb82d1f08238b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:58.648651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:58.703237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2db657307b648658d8eb82d1f08238b', 'request_id': 'req-d9cb9bc5-031a-44e1-add5-aceebbb154c8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.713629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2db657307b648658d8eb82d1f08238b', 'request_id': 'req-d9cb9bc5-031a-44e1-add5-aceebbb154c8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.720383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2db657307b648658d8eb82d1f08238b', 'request_id': 'req-d9cb9bc5-031a-44e1-add5-aceebbb154c8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.730812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] The token cache is being invalidate because project c2db657307b648658d8eb82d1f08238b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:58.731091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.731760 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.733309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1237/2500] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:58 2022] DELETE /identity/v3/projects/c2db657307b648658d8eb82d1f08238b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:58.737396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:58.748020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998228ad-3f2e-4a55-b913-84be6b10b506 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:58.806652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:58.807529 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:58.807810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:58.808086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] PATH_INFO: `/v3/users/60b9cf5d064943149c40a66389064fbb` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:58.809277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b9cf5d064943149c40a66389064fbb)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:58.811244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:58.858571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b9cf5d064943149c40a66389064fbb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.870904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b9cf5d064943149c40a66389064fbb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.878068 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b9cf5d064943149c40a66389064fbb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.878877 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b9cf5d064943149c40a66389064fbb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.886216 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1b211e27-9e87-4cfc-b710-b853e8701aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b9cf5d064943149c40a66389064fbb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:58.892343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1264/2501] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:15:58 2022] DELETE /identity/v3/users/60b9cf5d064943149c40a66389064fbb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:59.173048 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.174528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:59.188793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9bc5-031a-44e1-add5-aceebbb154c8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.248812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.249752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.250036 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.250312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] PATH_INFO: `/v3/projects/a56d88b3dfc5489abc3120c5766f6644` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.251530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56d88b3dfc5489abc3120c5766f6644)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.253446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.301230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56d88b3dfc5489abc3120c5766f6644', 'request_id': 'req-d5cb83c6-1439-4387-8378-da2dfacc1a97'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:59.310158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56d88b3dfc5489abc3120c5766f6644', 'request_id': 'req-d5cb83c6-1439-4387-8378-da2dfacc1a97'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:59.316836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56d88b3dfc5489abc3120c5766f6644', 'request_id': 'req-d5cb83c6-1439-4387-8378-da2dfacc1a97'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:59.327836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] The token cache is being invalidate because project a56d88b3dfc5489abc3120c5766f6644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:15:59.328120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:59.328784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d5cb83c6-1439-4387-8378-da2dfacc1a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:15:59.330394 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1238/2502] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:15:59 2022] DELETE /identity/v3/projects/a56d88b3dfc5489abc3120c5766f6644 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:15:59.335447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.335955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.336168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.354279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:59.355501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:59.416936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1265/2503] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:59.425235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.425522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.425833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.444727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:59.445976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:59.453863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1239/2504] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:59.458252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.468448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea774c6-4a54-45bb-8528-d3d908c17f60 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.472985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.473811 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.473962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.474927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.475427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:15:59.475730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.477330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.489330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1266/2505] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:15:59.494641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.503895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9cea3-da56-4fbf-ac2e-837a48cbf7a5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.510315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.511214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.511214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.511473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.512172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.514130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.541655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1240/2506] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:15:59.545923 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.556880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6358c6-ee80-4062-b898-4039fcc08d72 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.619045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.619725 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.620006 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.620287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.621011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.622968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.649687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1267/2507] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:59.650112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.660242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68be7a-0702-4b67-81fa-3fc8ad399fb9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.665623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.666300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.666580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.666853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.667632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.669185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.680610 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1241/2508] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:15:59.684587 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.695138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fb0f4-fa3d-497d-86ce-f87b0aa2e14a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.699971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab720e1-e668-4844-b78b-4a4cef3979aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.700641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab720e1-e668-4844-b78b-4a4cef3979aa admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.700926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab720e1-e668-4844-b78b-4a4cef3979aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.701206 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab720e1-e668-4844-b78b-4a4cef3979aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.701978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab720e1-e668-4844-b78b-4a4cef3979aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.703595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab720e1-e668-4844-b78b-4a4cef3979aa admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.714457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1268/2509] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:15:59.719186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.730216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d58cf-1f79-48f8-ba0b-f55d5d216fb9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.734964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.735853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.736139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.736422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] PATH_INFO: `/v3/projects/4cfd0072a58849fabb6a2c109d5d9904/users/3a9bc329d7434398a3bfd0304298f28d/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.752996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfd0072a58849fabb6a2c109d5d9904, user_id=3a9bc329d7434398a3bfd0304298f28d, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.755755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.769822 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1242/2510] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:15:59 2022] PUT /identity/v3/projects/4cfd0072a58849fabb6a2c109d5d9904/users/3a9bc329d7434398a3bfd0304298f28d/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:15:59.782247 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.782817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.783088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.811377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] MFA Rules not processed for user `3a9bc329d7434398a3bfd0304298f28d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:15:59.812593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:15:59.876783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1269/2511] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:15:59.881779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:15:59.953679 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda785f8-e196-4091-99b6-45c14136b4da admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:15:59.959243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:15:59.959900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:15:59.960179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:15:59.960449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:15:59.961136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:15:59.963056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:15:59.992149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1243/2512] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:15:59.993747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:00.004353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67d4c-d5e2-44b1-bc9b-bfc5c2ca6011 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:00.063578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:00.064263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.064551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.064938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.065532 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:00.068424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:00.089443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1270/2513] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:15:59 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:00.093459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:00.109209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c43a38-ccc6-455f-8812-00d0017b7880 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:00.114136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:00.115108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.115384 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.115674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.116388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:00.118424 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:00.129796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1244/2514] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:00.134797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:00.145070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25ce14-82ff-430f-aaae-7eb26e8eaced admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:00.151427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:00.152324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.152605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.152875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] PATH_INFO: `/v3/projects/fcbe58204e35469ba372dc22c2ba13cb/users/c8c1d56afdac4866819639574208a88c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.169476 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbe58204e35469ba372dc22c2ba13cb, user_id=c8c1d56afdac4866819639574208a88c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:00.172386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:00.189010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1271/2515] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:00 2022] PUT /identity/v3/projects/fcbe58204e35469ba372dc22c2ba13cb/users/c8c1d56afdac4866819639574208a88c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:00.194197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:00.206808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc58ed2-53c0-47c9-9d5b-046e1c3dab95 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:00.268081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008941-c083-4dd9-b6ad-76e8d582efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:00.268791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008941-c083-4dd9-b6ad-76e8d582efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.269070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008941-c083-4dd9-b6ad-76e8d582efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.269343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008941-c083-4dd9-b6ad-76e8d582efd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.270131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e008941-c083-4dd9-b6ad-76e8d582efd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:00.272320 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e008941-c083-4dd9-b6ad-76e8d582efd8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:00.283432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1245/2516] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:00.287674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:00.298576 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4f04-bbd1-456e-8ea8-c20a6b5fe9f8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:00.303514 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:00.304562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.304718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.304954 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] PATH_INFO: `/v3/projects/fcbe58204e35469ba372dc22c2ba13cb/users/c8c1d56afdac4866819639574208a88c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.307027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbe58204e35469ba372dc22c2ba13cb, user_id=c8c1d56afdac4866819639574208a88c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:00.309795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:00.321131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1272/2517] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:00 2022] PUT /identity/v3/projects/fcbe58204e35469ba372dc22c2ba13cb/users/c8c1d56afdac4866819639574208a88c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:00.331265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.331555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.331870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.359118 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] MFA Rules not processed for user `c8c1d56afdac4866819639574208a88c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:00.360342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:00.432622 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1246/2518] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:00.444296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:00.446079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:00.505995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15f9dd-a106-4932-9714-59da1494b197 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:00.509882 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:00.510545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:00.510828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:00.511101 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:00.575167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:00.576618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:00.586545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1273/2519] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:05.148471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:05.150126 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:05.219515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777662d-3d94-48bb-8043-fb72d4abb38f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:05.227435 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:05.228108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:05.228391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:05.228666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:05.230848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:05.249487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:05.249487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:05.260839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1247/2520] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:06.294159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:06.295813 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:06.308979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d12bc6-44ee-4104-b545-9df2a550cabf service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:06.312889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:06.314166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:06.314541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:06.314828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:06.325952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:06.327548 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:06.338488 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1274/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:16:12.224685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:12.226120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:12.289032 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee62a1-17f0-44d8-b894-74f4d9705f3a service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:12.293300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:12.293986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:12.294271 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:12.294548 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:12.296592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:12.378181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:12.380764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:12.391631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1248/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:15.813509 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:15.815282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:15.832416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2201c-0482-4946-a0ce-38fc9fb44037 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:15.838146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:15.839011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:15.839293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:15.839722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] PATH_INFO: `/v3/users/59ae8544d37b4de78c4164fc9de7acb4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:15.840915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ae8544d37b4de78c4164fc9de7acb4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:15.842843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:15.895035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ae8544d37b4de78c4164fc9de7acb4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:15.907395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ae8544d37b4de78c4164fc9de7acb4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:15.915096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ae8544d37b4de78c4164fc9de7acb4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:15.915802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ae8544d37b4de78c4164fc9de7acb4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:15.922700 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-04b5aa6f-06be-4f50-a3e0-8f9d1a24832a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ae8544d37b4de78c4164fc9de7acb4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:15.929839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1275/2523] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:15 2022] DELETE /identity/v3/users/59ae8544d37b4de78c4164fc9de7acb4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:16.108167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.122298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc851b4a-54f2-49cd-b88f-b28795f67d45 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.196614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.197629 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.197994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.198347 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] PATH_INFO: `/v3/projects/79beb8c8a2f7430f9d5011cfb455acc7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.199817 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79beb8c8a2f7430f9d5011cfb455acc7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.202370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.257436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79beb8c8a2f7430f9d5011cfb455acc7', 'request_id': 'req-39368acc-be09-4fc8-bfdb-6981db312f03'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:16.265520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79beb8c8a2f7430f9d5011cfb455acc7', 'request_id': 'req-39368acc-be09-4fc8-bfdb-6981db312f03'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:16.273865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79beb8c8a2f7430f9d5011cfb455acc7', 'request_id': 'req-39368acc-be09-4fc8-bfdb-6981db312f03'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:16.285457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] The token cache is being invalidate because project 79beb8c8a2f7430f9d5011cfb455acc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:16.285931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:16.286664 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-39368acc-be09-4fc8-bfdb-6981db312f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:16.288983 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1249/2524] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:16 2022] DELETE /identity/v3/projects/79beb8c8a2f7430f9d5011cfb455acc7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:16.293965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.294337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.294616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.311787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:16.312978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:16.374815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1276/2525] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:16.383300 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.383592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.383871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.403147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:16.404364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:16.413237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1250/2526] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:16.418207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.429362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c5fbe-03ab-4ec1-bb32-06c7bb03cb33 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.434057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.434709 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.434993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.435266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.435983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:16.436287 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.437931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.450741 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1277/2527] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:16:16.454961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.465646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3da2-b1e6-4b31-96d7-8f94c904c286 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.470592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.471287 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.471601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.471880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.472804 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.475346 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.506264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1251/2528] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:16 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:16:16.510690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.520854 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11dd4-9af5-4f47-8fc4-f657bf24dacd admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.583475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.584419 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.584768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.585110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.585892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.587909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.612048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1278/2529] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:16 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:16:16.613778 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.626113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44c4a-f44d-41fe-8142-f72a67a975c4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.638762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.639516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.639867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.640214 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.640953 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.642627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.653830 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1252/2530] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:16.658149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.669081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dcd71-20bc-4661-aee7-248c7249c911 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.673993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8bd97-7d1f-4169-9a64-eb284cbaeba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.674624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8bd97-7d1f-4169-9a64-eb284cbaeba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.674920 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8bd97-7d1f-4169-9a64-eb284cbaeba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.675172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8bd97-7d1f-4169-9a64-eb284cbaeba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.675890 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8bd97-7d1f-4169-9a64-eb284cbaeba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.678208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8bd97-7d1f-4169-9a64-eb284cbaeba1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.688224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1279/2531] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:16.692963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.703336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac0b31-fcc5-4669-829a-3073d1b2a472 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.707886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.708847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.709124 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.709395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] PATH_INFO: `/v3/projects/8519fdc1bc344de8936daa7afbe617cf/users/12e7cbcec78d45529d54c8c7385cbdd7/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.724089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8519fdc1bc344de8936daa7afbe617cf, user_id=12e7cbcec78d45529d54c8c7385cbdd7, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.727355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:16.740973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1253/2532] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:16 2022] PUT /identity/v3/projects/8519fdc1bc344de8936daa7afbe617cf/users/12e7cbcec78d45529d54c8c7385cbdd7/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:16.752688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.752982 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.753348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.782169 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] MFA Rules not processed for user `12e7cbcec78d45529d54c8c7385cbdd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:16.783382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:16.851939 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1280/2533] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:16.864579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:16.866538 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:16.957314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d90b5-e452-452d-831d-fe6a0f40c538 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:16.966680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295ca2-d107-4e43-8487-0ad4d2803b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:16.967630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295ca2-d107-4e43-8487-0ad4d2803b03 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:16.968039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295ca2-d107-4e43-8487-0ad4d2803b03 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:16.968469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295ca2-d107-4e43-8487-0ad4d2803b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:16.983011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295ca2-d107-4e43-8487-0ad4d2803b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:16.985439 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295ca2-d107-4e43-8487-0ad4d2803b03 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:17.002493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1254/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:29.636263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:29.717996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afd7aa-cc31-4f59-acb3-7bb3dbc3bc3c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:29.725654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:29.726953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:29.727440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:29.727864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] PATH_INFO: `/v3/users/12e7cbcec78d45529d54c8c7385cbdd7` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:29.729719 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e7cbcec78d45529d54c8c7385cbdd7)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:29.732559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:29.796930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e7cbcec78d45529d54c8c7385cbdd7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:29.809272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e7cbcec78d45529d54c8c7385cbdd7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:29.817640 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e7cbcec78d45529d54c8c7385cbdd7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:29.818721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e7cbcec78d45529d54c8c7385cbdd7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:29.826949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e7cbcec78d45529d54c8c7385cbdd7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:29.835299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1281/2535] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:29 2022] DELETE /identity/v3/users/12e7cbcec78d45529d54c8c7385cbdd7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:29.840888 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:29.841376 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:29.841752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:29.863904 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:29.865645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:29.931499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1255/2536] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:29.942760 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:29.944533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:30.017526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbf2f-aac8-477a-8e35-11c791f43637 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.024300 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cd729-923a-4e5f-8ee0-0b1fcbadcd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.025062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd729-923a-4e5f-8ee0-0b1fcbadcd70 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.025398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd729-923a-4e5f-8ee0-0b1fcbadcd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.025773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd729-923a-4e5f-8ee0-0b1fcbadcd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.037092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cd729-923a-4e5f-8ee0-0b1fcbadcd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.039545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cd729-923a-4e5f-8ee0-0b1fcbadcd70 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.051230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1282/2537] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:30.364586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.366112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:30.379689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610fa80-e4d5-4b63-87b6-9e032adcee5d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.384542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.385416 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.385745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.386075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] PATH_INFO: `/v3/projects/8519fdc1bc344de8936daa7afbe617cf` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.387224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8519fdc1bc344de8936daa7afbe617cf)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.389186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.442264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8519fdc1bc344de8936daa7afbe617cf', 'request_id': 'req-a78a75db-c89c-42d4-877f-4231e591148c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:30.451502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8519fdc1bc344de8936daa7afbe617cf', 'request_id': 'req-a78a75db-c89c-42d4-877f-4231e591148c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:30.458250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8519fdc1bc344de8936daa7afbe617cf', 'request_id': 'req-a78a75db-c89c-42d4-877f-4231e591148c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:30.469438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] The token cache is being invalidate because project 8519fdc1bc344de8936daa7afbe617cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:30.469895 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:30.470582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a78a75db-c89c-42d4-877f-4231e591148c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:30.472169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1256/2538] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:30 2022] DELETE /identity/v3/projects/8519fdc1bc344de8936daa7afbe617cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:30.478970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.479567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.479925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.499522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:30.500730 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:30.567408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1283/2539] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:30.578552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.578935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.579334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.604000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:30.605486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:30.615488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1257/2540] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:30.620110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.629999 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351c53-4d5c-44c8-9033-9a63400cb74f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.634779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.635444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.635728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.636005 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.636732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:30.637273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.638660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.654962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1284/2541] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:16:30.657055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.667176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cefc78-9557-4829-8335-c6c3d16475fe None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.671938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.672595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.672880 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.673159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.673894 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.675905 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.702465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1258/2542] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:30 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:30.706830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.717527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f5239-a968-4319-814d-ba1ca914948e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.783099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.783779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.784146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.784380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.785061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.787016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.809383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1285/2543] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:30 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:30.813004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.824505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0079a-4bb1-4165-b144-adaaf8000466 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.830270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.832349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.832349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.832349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.832726 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.836086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.847835 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1259/2544] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:16:30.852259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.864751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded474bb-8593-4505-8a88-13e5e9936bda admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.870312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5eb28-e00d-413e-9b6e-b255c87139d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.871140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5eb28-e00d-413e-9b6e-b255c87139d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.871457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5eb28-e00d-413e-9b6e-b255c87139d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.871908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5eb28-e00d-413e-9b6e-b255c87139d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.872825 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5eb28-e00d-413e-9b6e-b255c87139d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.874931 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5eb28-e00d-413e-9b6e-b255c87139d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.890172 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1286/2545] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:30.896847 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:30.908802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b58d0-5aee-4abd-b3b5-59d402b19358 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:30.914047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:30.914949 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.915228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.915502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] PATH_INFO: `/v3/projects/f1842b9577c84e209e2435d2c76884fd/users/7b64aab05e804b3aa21b4668db652e8b/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.933651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1842b9577c84e209e2435d2c76884fd, user_id=7b64aab05e804b3aa21b4668db652e8b, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:30.936991 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:30.953294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1260/2546] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:30 2022] PUT /identity/v3/projects/f1842b9577c84e209e2435d2c76884fd/users/7b64aab05e804b3aa21b4668db652e8b/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:30.966904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:30.967250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:30.967578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:30.996561 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] MFA Rules not processed for user `7b64aab05e804b3aa21b4668db652e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:30.997969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:31.080105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1287/2547] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:31.081593 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.160827 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e8667-647c-4c31-8088-8347443b9bd7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.166361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.167054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.167348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.167636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.168404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.170589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.202002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1261/2548] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:31 2022] POST /identity/v3/projects => generated 355 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:31.203222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.219345 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856ec9-dfa6-4be7-a02e-20e405e83559 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.287026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.287707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.287991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.288285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.288976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.290941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.316042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1288/2549] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:31 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:31.320690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.331422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bafd6b-173c-467e-b4b8-d31d18e14a2a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.336761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.337987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.338283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.338690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.339459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.341083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.357601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1262/2550] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:16:31.360275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.371326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f452a-9b9f-41f2-9ae5-168d584edec9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.378070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.378070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.378070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.378374 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] PATH_INFO: `/v3/projects/73ca7ebe4d6c4c879a3c7ba516da4002/users/cfe9182988aa47b48294ba51ff73144a/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.396848 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ca7ebe4d6c4c879a3c7ba516da4002, user_id=cfe9182988aa47b48294ba51ff73144a, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.399850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.412964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1289/2551] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:31 2022] PUT /identity/v3/projects/73ca7ebe4d6c4c879a3c7ba516da4002/users/cfe9182988aa47b48294ba51ff73144a/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:31.417028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.427310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567299-d3fd-4b27-905b-d1f9123c01b5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.488256 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8650c-0757-4078-8d18-e2dcaae24f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.488975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8650c-0757-4078-8d18-e2dcaae24f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.489257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8650c-0757-4078-8d18-e2dcaae24f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.489531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8650c-0757-4078-8d18-e2dcaae24f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.490297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8650c-0757-4078-8d18-e2dcaae24f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.492469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8650c-0757-4078-8d18-e2dcaae24f7b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.502824 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1263/2552] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:31.506775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.518118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b989a84-26d8-4353-857d-d5ea3d65d85b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.524913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.525870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.526148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.526455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] PATH_INFO: `/v3/projects/73ca7ebe4d6c4c879a3c7ba516da4002/users/cfe9182988aa47b48294ba51ff73144a/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.528568 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ca7ebe4d6c4c879a3c7ba516da4002, user_id=cfe9182988aa47b48294ba51ff73144a, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.531332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.542979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1290/2553] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:31 2022] PUT /identity/v3/projects/73ca7ebe4d6c4c879a3c7ba516da4002/users/cfe9182988aa47b48294ba51ff73144a/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:31.556471 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.556759 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.557031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.587774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] MFA Rules not processed for user `cfe9182988aa47b48294ba51ff73144a`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:31.588938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:31.674465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1264/2554] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:31 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:31.686396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.688067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:31.746672 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e463-d5f6-4490-98dc-56b760d58f32 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.751964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.752908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.753328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.753774 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.767507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.769812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.780305 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1291/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:31.854754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:31.865197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614dbb2-2306-4a6d-b455-76eceb22754b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:31.868873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420004-1861-41ce-9473-7aee9a70ebda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:31.869509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420004-1861-41ce-9473-7aee9a70ebda service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:31.869820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420004-1861-41ce-9473-7aee9a70ebda service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:31.870097 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420004-1861-41ce-9473-7aee9a70ebda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:31.929746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420004-1861-41ce-9473-7aee9a70ebda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:31.931190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420004-1861-41ce-9473-7aee9a70ebda service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:31.940406 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1265/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:33.537014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:33.539105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:33.608090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff78f-3a7a-43bc-9789-5f4413d34ee4 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:33.612613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:33.613673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:33.614086 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:33.614448 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] PATH_INFO: `/v3/users/3a9bc329d7434398a3bfd0304298f28d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:33.615911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9bc329d7434398a3bfd0304298f28d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:33.617962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:33.676491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9bc329d7434398a3bfd0304298f28d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:33.687944 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9bc329d7434398a3bfd0304298f28d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:33.696139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9bc329d7434398a3bfd0304298f28d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:33.696778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9bc329d7434398a3bfd0304298f28d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:33.704069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9bc329d7434398a3bfd0304298f28d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:33.711183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1292/2557] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:33 2022] DELETE /identity/v3/users/3a9bc329d7434398a3bfd0304298f28d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:33.716131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29164-79da-434e-8aae-48e686887682 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:33.716589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29164-79da-434e-8aae-48e686887682 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:33.716819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29164-79da-434e-8aae-48e686887682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:33.733614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-92a29164-79da-434e-8aae-48e686887682 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:33.734938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-92a29164-79da-434e-8aae-48e686887682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:33.800189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1266/2558] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:33.810168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:33.811597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:33.869386 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911c35-de7d-4f85-a17a-61cc4cc6c79c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:33.873149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:33.873851 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:33.874128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:33.874407 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:33.884883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:33.886367 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:33.896544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1293/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:34.177900 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a29164-79da-434e-8aae-48e686887682 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:34.179883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-92a29164-79da-434e-8aae-48e686887682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:34.192153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a29164-79da-434e-8aae-48e686887682 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:34.197632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:34.198509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:34.198787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:34.199061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] PATH_INFO: `/v3/projects/4cfd0072a58849fabb6a2c109d5d9904` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:34.200299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfd0072a58849fabb6a2c109d5d9904)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:34.202345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:34.253225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfd0072a58849fabb6a2c109d5d9904', 'request_id': 'req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.262209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfd0072a58849fabb6a2c109d5d9904', 'request_id': 'req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.269113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfd0072a58849fabb6a2c109d5d9904', 'request_id': 'req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.279766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] The token cache is being invalidate because project 4cfd0072a58849fabb6a2c109d5d9904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:34.280054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.280693 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.282387 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1267/2560] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:34 2022] DELETE /identity/v3/projects/4cfd0072a58849fabb6a2c109d5d9904 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:34.286837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:34.297878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155e5c3-e3f8-41fb-94f7-a40928834f7b service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:34.358378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:34.359248 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:34.359527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:34.359797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] PATH_INFO: `/v3/users/c8c1d56afdac4866819639574208a88c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:34.360994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c1d56afdac4866819639574208a88c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:34.362996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:34.418391 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c1d56afdac4866819639574208a88c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.432057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c1d56afdac4866819639574208a88c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.439240 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c1d56afdac4866819639574208a88c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.439915 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c1d56afdac4866819639574208a88c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.448667 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ee30c5f-e066-4493-a48c-2c637ceeb0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c1d56afdac4866819639574208a88c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.456869 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1294/2561] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:34 2022] DELETE /identity/v3/users/c8c1d56afdac4866819639574208a88c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:34.786660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:34.789625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:34.807326 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0bb2a-fc6c-4df5-828d-d05c59f955cb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:34.868956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:34.869976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:34.870253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:34.870573 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] PATH_INFO: `/v3/projects/fcbe58204e35469ba372dc22c2ba13cb` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:34.871802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbe58204e35469ba372dc22c2ba13cb)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:34.873736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:34.924680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbe58204e35469ba372dc22c2ba13cb', 'request_id': 'req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.933523 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbe58204e35469ba372dc22c2ba13cb', 'request_id': 'req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.940398 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbe58204e35469ba372dc22c2ba13cb', 'request_id': 'req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.958640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] The token cache is being invalidate because project fcbe58204e35469ba372dc22c2ba13cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:34.958910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.959558 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bf6ea811-5ef3-41fc-9e3b-60b1b09a05b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:34.961927 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1268/2562] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:34 2022] DELETE /identity/v3/projects/fcbe58204e35469ba372dc22c2ba13cb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:34.967473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:34.968014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:34.968152 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:34.986282 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:34.987669 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:35.058405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1295/2563] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:35.067942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.068190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.068420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.089646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:35.090899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:35.099165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1269/2564] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:35.104174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.114167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917e9cd-3c16-4174-aaef-8a6768236441 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.119182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.119889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.120322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.120604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.121366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:35.121710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.123341 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.135112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1296/2565] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:16:35.139526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.149691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e32af7-0fd5-4c6b-b6c9-36de8ec74fe5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.154371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.155041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.155325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.155601 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.156286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.158249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.183514 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1270/2566] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:35.187836 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.198485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33772db-dad1-4b8e-8b5f-158360dc221c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.253976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.254645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.254925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.255200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.255885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.258450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.278783 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1297/2567] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:35.283062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.293073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede05b4-5939-4f62-9bdb-2327abd9e1ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.297592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.298257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.298534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.298808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.299524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.301165 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.311813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1271/2568] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:35.315841 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.326797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96213ea-37fd-4519-a347-5d2c0b16f661 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.332303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7594da-9fd6-43a5-b378-68ad9348f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.332968 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7594da-9fd6-43a5-b378-68ad9348f727 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.333279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7594da-9fd6-43a5-b378-68ad9348f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.333578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7594da-9fd6-43a5-b378-68ad9348f727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.334317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7594da-9fd6-43a5-b378-68ad9348f727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.336497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7594da-9fd6-43a5-b378-68ad9348f727 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.346696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1298/2569] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:35.351401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.361277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a848ce-1c57-44b5-b980-2af0854ea672 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.366586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.367475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.367766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.368072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] PATH_INFO: `/v3/projects/041ef02a148f4286803c40080c48b76d/users/6032e8ca448547d1ad3b1b3b94d3a4a1/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.383987 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=041ef02a148f4286803c40080c48b76d, user_id=6032e8ca448547d1ad3b1b3b94d3a4a1, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.386723 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.400397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1272/2570] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:35 2022] PUT /identity/v3/projects/041ef02a148f4286803c40080c48b76d/users/6032e8ca448547d1ad3b1b3b94d3a4a1/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:35.411217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.411500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.411776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.437927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] MFA Rules not processed for user `6032e8ca448547d1ad3b1b3b94d3a4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:35.439128 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:35.503092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1299/2571] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:35.508196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.570301 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0db352-7297-4b27-aa56-a528a12b0e9f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.574950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.575608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.575893 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.576174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.576932 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.578826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.604577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1273/2572] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:16:35.607913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.618984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fc510-7915-46af-bd60-357a06b02941 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.676304 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.676970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.677254 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.677534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.678375 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.680765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.701922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1300/2573] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:35.706411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.716636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8e6a7-1ce7-4e35-9a97-9252d32f0dcc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.725176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.725901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.726187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.726467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.727208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.728823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.740294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1274/2574] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:35.746565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.759625 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244dc72-2b4f-4ccd-908b-05ce4073e734 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.764365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465e734-3a54-48a4-8ad7-b1c8c998b2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.765031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e734-3a54-48a4-8ad7-b1c8c998b2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.765365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e734-3a54-48a4-8ad7-b1c8c998b2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.765604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e734-3a54-48a4-8ad7-b1c8c998b2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.766340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465e734-3a54-48a4-8ad7-b1c8c998b2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.767969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465e734-3a54-48a4-8ad7-b1c8c998b2d4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.779042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1301/2575] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:35.782985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:35.794637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3866a8-0abd-438d-aa6c-0dcab9cd4990 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:35.800551 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:35.801441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.801772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.802052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] PATH_INFO: `/v3/projects/ff432412b0a047d38b39a4ced0a466ae/users/5eab2ebdf055441e954da22e8f7b7e35/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.818265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff432412b0a047d38b39a4ced0a466ae, user_id=5eab2ebdf055441e954da22e8f7b7e35, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:35.821298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:35.834336 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1275/2576] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:35 2022] PUT /identity/v3/projects/ff432412b0a047d38b39a4ced0a466ae/users/5eab2ebdf055441e954da22e8f7b7e35/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:35.849010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:35.849214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:35.849496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:35.879879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] MFA Rules not processed for user `5eab2ebdf055441e954da22e8f7b7e35`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:35.881102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:35.947117 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1302/2577] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:35.951842 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.022228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496db9fe-b715-44b6-bdbf-3ad38c56e167 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.027192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.027853 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.028140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.028414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.029102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.031035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.061481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1276/2578] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:35 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:36.063082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.073850 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca89e5-d049-4566-804f-950499b80a2a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.131965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.132614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.132895 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.133171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.133969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.135925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.159981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1303/2579] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:36 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:36.161313 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.172691 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b608-d0a5-4c95-b231-8cf3db13ec51 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.178113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.178791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.179461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.179597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.180331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.182177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.197703 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1277/2580] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:36.198843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.208795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb659095-1d8a-4204-af1f-fe3c98c09024 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.214057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.214938 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.215215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.215487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] PATH_INFO: `/v3/projects/2b823e0df6844b16a34317524e9a9d0e/users/2afd2b63583748f1943beab3a99a998c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.230314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b823e0df6844b16a34317524e9a9d0e, user_id=2afd2b63583748f1943beab3a99a998c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.232951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.246800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1304/2581] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:36 2022] PUT /identity/v3/projects/2b823e0df6844b16a34317524e9a9d0e/users/2afd2b63583748f1943beab3a99a998c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:36.251984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.262876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9e0a-5733-40d7-a133-45f1c0aca068 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.321357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8292-53ed-4071-b926-e1cc8ca735ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.322170 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8292-53ed-4071-b926-e1cc8ca735ed admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.322583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8292-53ed-4071-b926-e1cc8ca735ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.322870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8292-53ed-4071-b926-e1cc8ca735ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.323600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8292-53ed-4071-b926-e1cc8ca735ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.325269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8292-53ed-4071-b926-e1cc8ca735ed admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.335330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1278/2582] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:36.339797 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.350445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b550507-fb30-43b6-953a-f60436446148 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.355122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.356041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.356371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.356639 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] PATH_INFO: `/v3/projects/2b823e0df6844b16a34317524e9a9d0e/users/2afd2b63583748f1943beab3a99a998c/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.358793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b823e0df6844b16a34317524e9a9d0e, user_id=2afd2b63583748f1943beab3a99a998c, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.361715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.372900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1305/2583] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:36 2022] PUT /identity/v3/projects/2b823e0df6844b16a34317524e9a9d0e/users/2afd2b63583748f1943beab3a99a998c/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:36.384109 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.384401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.384731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.414079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] MFA Rules not processed for user `2afd2b63583748f1943beab3a99a998c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:36.415284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:36.490458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1279/2584] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:36.502688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:36.505523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:36.560959 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea301d0-db98-4957-8922-8a81ed71a060 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:36.564678 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:36.565444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:36.565870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:36.566138 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:36.576297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:36.577759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:36.587614 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1306/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:37.073874 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:37.075368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:37.087546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e0bb-7b66-40a7-b304-ac8376915afc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:37.091058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:37.091702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:37.091984 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:37.092260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:37.152236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:37.153713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:37.162432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1280/2586] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:40.207501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:40.216099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc209ef5-17aa-4d57-b2fc-0b1698578d4d service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:40.219801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:40.220435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:40.220716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:40.220990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:40.222771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:40.286344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:40.288089 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:40.297187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1307/2587] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:41.179031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:41.187936 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ad225-0baa-4f48-a59a-780919bd0862 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:41.191654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0ddde-6309-49aa-804b-215e5985257d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:41.192278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ddde-6309-49aa-804b-215e5985257d service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:41.192560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ddde-6309-49aa-804b-215e5985257d service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:41.192838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ddde-6309-49aa-804b-215e5985257d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:41.253768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0ddde-6309-49aa-804b-215e5985257d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:41.255916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0ddde-6309-49aa-804b-215e5985257d service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:41.266075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1281/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:45.282951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:45.367708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf0227-d2b8-47ba-a35b-2b967c35dda1 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:45.372718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:45.374064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:45.374064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:45.374379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] PATH_INFO: `/v3/users/6032e8ca448547d1ad3b1b3b94d3a4a1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:45.375638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6032e8ca448547d1ad3b1b3b94d3a4a1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:45.377660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:45.434250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6032e8ca448547d1ad3b1b3b94d3a4a1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:45.448409 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6032e8ca448547d1ad3b1b3b94d3a4a1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:45.456446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6032e8ca448547d1ad3b1b3b94d3a4a1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:45.457095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6032e8ca448547d1ad3b1b3b94d3a4a1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:45.465351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6032e8ca448547d1ad3b1b3b94d3a4a1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:45.473220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1308/2589] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:45 2022] DELETE /identity/v3/users/6032e8ca448547d1ad3b1b3b94d3a4a1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:45.478428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:45.478947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:45.479047 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:45.496783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:45.498055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:45.565270 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1282/2590] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:45.576630 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:45.578739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:45.641924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5ca7c-955b-476d-8a81-39bab8f37d8f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:45.645570 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:45.646219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:45.646497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:45.646768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:45.657129 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:45.658588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:45.669265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1309/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:45.971496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:45.973356 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:45.985722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83602d71-eeda-4924-be6c-83984daf20c0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:45.991452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:45.992352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:45.992864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:45.993134 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] PATH_INFO: `/v3/projects/041ef02a148f4286803c40080c48b76d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:45.994481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=041ef02a148f4286803c40080c48b76d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:45.996623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:46.057312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041ef02a148f4286803c40080c48b76d', 'request_id': 'req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.066607 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041ef02a148f4286803c40080c48b76d', 'request_id': 'req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.074480 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041ef02a148f4286803c40080c48b76d', 'request_id': 'req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.085201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] The token cache is being invalidate because project 041ef02a148f4286803c40080c48b76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:46.085493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.086184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bc2faa09-375c-4a60-b968-4f8e33c6bc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.087741 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1283/2592] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:45 2022] DELETE /identity/v3/projects/041ef02a148f4286803c40080c48b76d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:46.091902 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:46.103363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9001-d433-4afb-a731-9c18b01c8060 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:46.161753 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:46.162682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:46.162958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:46.163230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] PATH_INFO: `/v3/users/5eab2ebdf055441e954da22e8f7b7e35` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:46.164492 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eab2ebdf055441e954da22e8f7b7e35)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:46.166632 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:46.213286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eab2ebdf055441e954da22e8f7b7e35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.224912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eab2ebdf055441e954da22e8f7b7e35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.232281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eab2ebdf055441e954da22e8f7b7e35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.232996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eab2ebdf055441e954da22e8f7b7e35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.240591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eab2ebdf055441e954da22e8f7b7e35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.247648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1310/2593] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:46 2022] DELETE /identity/v3/users/5eab2ebdf055441e954da22e8f7b7e35 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:46.345167 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:46.345529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:46.345767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:46.364929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] MFA Rules not processed for user `516432654a024122987075db3f43798f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:46.366761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:46.426388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1284/2594] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:46.554662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:46.557387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:46.655311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ceda4-fb05-40b0-a9bb-6217f26f95e5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:46.662329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:46.663735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:46.664258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:46.664565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] PATH_INFO: `/v3/projects/ff432412b0a047d38b39a4ced0a466ae` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:46.666263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff432412b0a047d38b39a4ced0a466ae)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:46.668360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:46.721425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff432412b0a047d38b39a4ced0a466ae', 'request_id': 'req-89550bb2-a952-4e12-b10a-4558c58571cf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.731066 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff432412b0a047d38b39a4ced0a466ae', 'request_id': 'req-89550bb2-a952-4e12-b10a-4558c58571cf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.738645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff432412b0a047d38b39a4ced0a466ae', 'request_id': 'req-89550bb2-a952-4e12-b10a-4558c58571cf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.755486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] The token cache is being invalidate because project ff432412b0a047d38b39a4ced0a466ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:46.755804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.756438 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.762091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1311/2595] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:46 2022] DELETE /identity/v3/projects/ff432412b0a047d38b39a4ced0a466ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:46.762851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:46.777172 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ffd6-d418-4c56-80f7-41700a65fa3f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:46.868519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:46.869373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:46.869745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:46.870011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] PATH_INFO: `/v3/users/2afd2b63583748f1943beab3a99a998c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:46.880137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afd2b63583748f1943beab3a99a998c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:46.882185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:46.932755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afd2b63583748f1943beab3a99a998c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.946227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afd2b63583748f1943beab3a99a998c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.947005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afd2b63583748f1943beab3a99a998c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.954924 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afd2b63583748f1943beab3a99a998c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.966253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-69b9c73a-3041-4743-bd3b-c64886f59c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afd2b63583748f1943beab3a99a998c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:46.976132 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1285/2596] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:46 2022] DELETE /identity/v3/users/2afd2b63583748f1943beab3a99a998c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:47.354470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.356286 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:47.378335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550bb2-a952-4e12-b10a-4558c58571cf admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.475262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.476132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.476442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.476718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] PATH_INFO: `/v3/projects/2b823e0df6844b16a34317524e9a9d0e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.477976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b823e0df6844b16a34317524e9a9d0e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.480084 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:47.526617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b823e0df6844b16a34317524e9a9d0e', 'request_id': 'req-29208913-dda7-48b4-90d4-08bcd493dbcd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:47.534628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b823e0df6844b16a34317524e9a9d0e', 'request_id': 'req-29208913-dda7-48b4-90d4-08bcd493dbcd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:47.541670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b823e0df6844b16a34317524e9a9d0e', 'request_id': 'req-29208913-dda7-48b4-90d4-08bcd493dbcd'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:47.554389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] The token cache is being invalidate because project 2b823e0df6844b16a34317524e9a9d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:47.554684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:47.555352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-29208913-dda7-48b4-90d4-08bcd493dbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:47.557738 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1312/2597] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:47 2022] DELETE /identity/v3/projects/2b823e0df6844b16a34317524e9a9d0e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:47.563721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.564003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.564281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.586235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:47.587972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:47.656815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1286/2598] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:47.665521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.665846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.666149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.685264 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:47.686605 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:47.695618 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1313/2599] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:47.700634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.711307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde084f-30cb-4d73-80aa-4c56fef3cc11 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.717061 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.717763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.718051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.718327 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.719057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:47.719367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.721010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:47.733030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1287/2600] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:16:47.737839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.748922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bf85-673f-4d5b-8bbe-d9ff9495f95d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.754602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.755262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.755546 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.755824 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.757251 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.759256 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:47.785518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1314/2601] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:47 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:16:47.790182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.800159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61daa-ac8e-45ff-ba3d-233c4a0f955d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.855180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.855765 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.856052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.856331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.857010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.858997 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:47.879588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1288/2602] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:47 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:47.884190 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.894511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2850-fd00-4abe-94c4-18956be2bc2c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.899839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.900519 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.900801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.901106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.901937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.903752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:47.915998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1315/2603] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:47.921099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.932580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1100a79-2d8c-4435-8206-b1b831cc879c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.937322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526a66-2f71-485a-9f05-9a15a5772e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.938027 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526a66-2f71-485a-9f05-9a15a5772e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.938306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526a66-2f71-485a-9f05-9a15a5772e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.938580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526a66-2f71-485a-9f05-9a15a5772e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.939305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f526a66-2f71-485a-9f05-9a15a5772e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.940931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f526a66-2f71-485a-9f05-9a15a5772e85 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:47.951979 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1289/2604] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:47.955874 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:47.965773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c019-f055-42c7-b2d0-aa06ba16b031 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:47.972878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:47.973283 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:47.973751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:47.974012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] PATH_INFO: `/v3/projects/c936ff14a51e4480a3760248809a49b8/users/eeb4a26126334b90ac30aff92739d272/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:47.991685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c936ff14a51e4480a3760248809a49b8, user_id=eeb4a26126334b90ac30aff92739d272, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:47.994373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:48.008099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1316/2605] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:47 2022] PUT /identity/v3/projects/c936ff14a51e4480a3760248809a49b8/users/eeb4a26126334b90ac30aff92739d272/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:48.023499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.024055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.024364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.057473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] MFA Rules not processed for user `eeb4a26126334b90ac30aff92739d272`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:48.059382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.137621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1290/2606] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:48.150881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:48.151965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.179303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:48.181352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.214095 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77f2a-e7a5-4aa6-85f3-cfc0e9e38508 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:48.218881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:48.219603 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.219913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.220183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.230105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:48.231554 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:48.241432 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1317/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:48.249503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e650b1-dca2-4b39-acef-44dcea07cebf None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:48.255257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:48.256168 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.256441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.256702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] PATH_INFO: `/v3/users/7b64aab05e804b3aa21b4668db652e8b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.258689 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b64aab05e804b3aa21b4668db652e8b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:48.262141 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:48.262552 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:48.274604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39ca4-9502-4702-bf89-02b61385bf8f service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:48.279631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:48.280498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.280804 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.281082 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] PATH_INFO: `/v3/users/eeb4a26126334b90ac30aff92739d272` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.282329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb4a26126334b90ac30aff92739d272)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:48.285038 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:48.318462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b64aab05e804b3aa21b4668db652e8b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.332775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b64aab05e804b3aa21b4668db652e8b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.333544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b64aab05e804b3aa21b4668db652e8b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.336525 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb4a26126334b90ac30aff92739d272'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.341058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b64aab05e804b3aa21b4668db652e8b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.349480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb4a26126334b90ac30aff92739d272'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.350750 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-64ab58e5-69aa-46a1-b5a0-522f048e9adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b64aab05e804b3aa21b4668db652e8b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.358720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1291/2608] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:48 2022] DELETE /identity/v3/users/7b64aab05e804b3aa21b4668db652e8b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:48.358957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb4a26126334b90ac30aff92739d272'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.360174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb4a26126334b90ac30aff92739d272'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.363057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.363363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.363732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.373513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a52ae318-58b6-4223-9d5a-b137cf181cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb4a26126334b90ac30aff92739d272'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:48.380852 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1318/2609] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:48 2022] DELETE /identity/v3/users/eeb4a26126334b90ac30aff92739d272 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:48.384720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:48.385681 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.385976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.386099 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.386257 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.405057 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:48.406323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.461414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1292/2610] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:48.475277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:48.482552 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.486324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1319/2611] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:48.495185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:48.497296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:48.558028 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a2f96-a8e5-443f-9a71-abd79cea9144 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:48.563674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:48.564661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.565045 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.565338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.568110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842a9e7-b253-4e4f-a34f-a249a168d0fc None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:48.572657 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:48.573315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:48.573879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:48.574062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:48.578174 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:48.580249 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:48.589313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:48.591358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:48.594268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1293/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:48.607380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1320/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:49.051173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.054135 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.071244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.074414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.076634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6b8f-c2d0-46a5-8d9c-85565b1d088c service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.085899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.088039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.088705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.089333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] PATH_INFO: `/v3/projects/f1842b9577c84e209e2435d2c76884fd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.091864 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1842b9577c84e209e2435d2c76884fd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.096055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.110310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc8b9-fba8-4994-90dc-88628807605c service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.121200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.122422 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.123365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.123849 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] PATH_INFO: `/v3/projects/c936ff14a51e4480a3760248809a49b8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.125512 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c936ff14a51e4480a3760248809a49b8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.128455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.175433 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1842b9577c84e209e2435d2c76884fd', 'request_id': 'req-d536792f-2179-4d57-bb77-a55d2f501a87'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.185391 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1842b9577c84e209e2435d2c76884fd', 'request_id': 'req-d536792f-2179-4d57-bb77-a55d2f501a87'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.187956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c936ff14a51e4480a3760248809a49b8', 'request_id': 'req-70705dee-1e35-47c0-bd3e-c17cd7525e9a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.192350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1842b9577c84e209e2435d2c76884fd', 'request_id': 'req-d536792f-2179-4d57-bb77-a55d2f501a87'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.197202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c936ff14a51e4480a3760248809a49b8', 'request_id': 'req-70705dee-1e35-47c0-bd3e-c17cd7525e9a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.206029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] The token cache is being invalidate because project f1842b9577c84e209e2435d2c76884fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:49.206413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.206974 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c936ff14a51e4480a3760248809a49b8', 'request_id': 'req-70705dee-1e35-47c0-bd3e-c17cd7525e9a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.207328 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.208956 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1294/2614] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:49 2022] DELETE /identity/v3/projects/f1842b9577c84e209e2435d2c76884fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:49.212757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.214150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.218793 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] The token cache is being invalidate because project c936ff14a51e4480a3760248809a49b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:49.219083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.219771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-70705dee-1e35-47c0-bd3e-c17cd7525e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.221319 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1321/2615] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:49 2022] DELETE /identity/v3/projects/c936ff14a51e4480a3760248809a49b8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:49.226007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063c3e7-5290-447c-845b-8b48d2bedd60 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.226387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063c3e7-5290-447c-845b-8b48d2bedd60 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.226663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063c3e7-5290-447c-845b-8b48d2bedd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.246103 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e063c3e7-5290-447c-845b-8b48d2bedd60 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:49.247334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e063c3e7-5290-447c-845b-8b48d2bedd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.279879 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536792f-2179-4d57-bb77-a55d2f501a87 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.307675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1322/2616] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:49.316392 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.316690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.317046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.337376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:49.339102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.343074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.344091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.344467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.344850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] PATH_INFO: `/v3/users/cfe9182988aa47b48294ba51ff73144a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.346382 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe9182988aa47b48294ba51ff73144a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.347997 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1323/2617] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:49.348677 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.352909 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.363222 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da4734-2efb-47ef-a9d9-9c29a01b9aba None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.373199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.373916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.374201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.375048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.375281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:49.375524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.377191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.391518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1324/2618] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:16:49.396369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.409365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bffd73-27a2-4863-929d-0d5d9481eb9e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.415900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.416594 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.416878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.417150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.418022 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.420238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe9182988aa47b48294ba51ff73144a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.421016 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.450466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe9182988aa47b48294ba51ff73144a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.451385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe9182988aa47b48294ba51ff73144a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.459539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe9182988aa47b48294ba51ff73144a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.472786 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe9182988aa47b48294ba51ff73144a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:49.473420 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1325/2619] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:49 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:16:49.475826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.479949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.488039 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1295/2620] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:49 2022] DELETE /identity/v3/users/cfe9182988aa47b48294ba51ff73144a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:16:49.562950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3c789-6a47-4e72-ad5a-46ac54fd31c0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.630687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.632244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.632661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.633008 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.633682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.635784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.659704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1326/2621] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:49 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:49.664636 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.684236 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0b652-1501-4e1c-bef4-5fb2ca0301ee admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.710614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.712143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.712448 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.712730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.713492 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.715699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.736428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1296/2622] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:49.737595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.753143 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791800-677c-4e68-88ff-0acda6485985 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.760493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d773e0-ff6c-46de-8b94-9f800f71c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.762281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d773e0-ff6c-46de-8b94-9f800f71c8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.763125 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d773e0-ff6c-46de-8b94-9f800f71c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.763616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d773e0-ff6c-46de-8b94-9f800f71c8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.764560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d773e0-ff6c-46de-8b94-9f800f71c8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.766889 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d773e0-ff6c-46de-8b94-9f800f71c8a0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.780198 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1327/2623] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:49.784624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.803825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0e43-f68b-425e-8418-d2706a2d6f72 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:49.811474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:49.811474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.811474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.811474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] PATH_INFO: `/v3/projects/a13b0b98394248d6bd5c12a6780bc71d/users/e8e96a95db814006b148f1f1f8307341/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.829503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13b0b98394248d6bd5c12a6780bc71d, user_id=e8e96a95db814006b148f1f1f8307341, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:49.833447 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:49.853042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1297/2624] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:49 2022] PUT /identity/v3/projects/a13b0b98394248d6bd5c12a6780bc71d/users/e8e96a95db814006b148f1f1f8307341/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:49.865281 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:49.865898 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:49.866347 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:49.905832 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] MFA Rules not processed for user `e8e96a95db814006b148f1f1f8307341`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:49.907478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:49.979334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1328/2625] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:49.993597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:49.995657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:50.085056 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:50.088539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:50.101499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68c966-6393-479a-bda3-0e66d9d550bd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.107018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.107920 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.108343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.109250 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.134515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:50.136185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:50.150988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1298/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:50.194815 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:50.242270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0f967-36c3-4879-b579-6ef2862ec113 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.258737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.260607 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.261296 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.261830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] PATH_INFO: `/v3/projects/73ca7ebe4d6c4c879a3c7ba516da4002` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.263361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ca7ebe4d6c4c879a3c7ba516da4002)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:50.265578 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:50.303807 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f061-8e3b-4b34-a704-119edabab5d8 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.313721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.314976 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.315371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.315753 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] PATH_INFO: `/v3/users/e8e96a95db814006b148f1f1f8307341` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.319818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e96a95db814006b148f1f1f8307341)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:50.327517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:50.329687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ca7ebe4d6c4c879a3c7ba516da4002', 'request_id': 'req-75d325e5-5770-47a0-b012-a313f053331d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.340399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ca7ebe4d6c4c879a3c7ba516da4002', 'request_id': 'req-75d325e5-5770-47a0-b012-a313f053331d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.354168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ca7ebe4d6c4c879a3c7ba516da4002', 'request_id': 'req-75d325e5-5770-47a0-b012-a313f053331d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.383834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] The token cache is being invalidate because project 73ca7ebe4d6c4c879a3c7ba516da4002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:50.384326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.385167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-75d325e5-5770-47a0-b012-a313f053331d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.388757 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1329/2627] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:50 2022] DELETE /identity/v3/projects/73ca7ebe4d6c4c879a3c7ba516da4002 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:50.393792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7824e2-1950-4c07-80a3-376e33d34c66 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.394454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7824e2-1950-4c07-80a3-376e33d34c66 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.394756 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7824e2-1950-4c07-80a3-376e33d34c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.407732 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e96a95db814006b148f1f1f8307341'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.417984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4d7824e2-1950-4c07-80a3-376e33d34c66 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:50.419343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d7824e2-1950-4c07-80a3-376e33d34c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:50.431294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e96a95db814006b148f1f1f8307341'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.432321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e96a95db814006b148f1f1f8307341'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.450954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e96a95db814006b148f1f1f8307341'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.462883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2d626ead-f0ce-4b6a-abf1-364b9bdf4671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e96a95db814006b148f1f1f8307341'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:50.477202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1299/2628] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:16:50 2022] DELETE /identity/v3/users/e8e96a95db814006b148f1f1f8307341 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:50.479136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.479671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.480201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.506806 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:50.508468 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:50.558170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1330/2629] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:50.559847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.560132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.560405 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.604451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1300/2630] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:50.607513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:50.608918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:50.633377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1331/2631] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:50.637868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:50.649843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37bfab-f859-45af-b479-5e87374283fa None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.672945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.673688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.673982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.674404 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.675357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:50.675675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:50.680082 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:50.694686 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:50.696462 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:50.728183 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1301/2632] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:16:50.733299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:50.772811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a4e86-7bb6-4840-a2bd-ab080fb11332 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.791512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.792195 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.792474 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.792769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.793432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:50.795852 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:50.844318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1302/2633] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:50 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:50.848530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:50.868884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14146224-a47c-45df-bb32-0492dbb67416 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.942986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.944635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.944916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.945355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.969164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9ee2-89e4-42a4-8b7b-b35fde20eba4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:50.978285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:50.979029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:50.979348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:50.979620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:50.980410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:50.982413 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:51.017374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1303/2634] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:50 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:51.019230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:51.044173 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f70ea-c9d1-4a3d-9540-1ebfe07aeb92 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:51.050199 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:51.051140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:51.051578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:51.052153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:51.053754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:51.054675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:51.055788 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:51.056185 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:51.067967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1304/2635] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:51.072130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:51.074054 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1332/2636] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:51.083330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5cd4f-d20b-4281-a3a7-82fdecce19d6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:51.090226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21c04-6383-47a9-b39f-f40acde16a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:51.091041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21c04-6383-47a9-b39f-f40acde16a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:51.091393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21c04-6383-47a9-b39f-f40acde16a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:51.091738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21c04-6383-47a9-b39f-f40acde16a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:51.092564 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21c04-6383-47a9-b39f-f40acde16a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:51.094334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21c04-6383-47a9-b39f-f40acde16a4e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:51.108884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1305/2637] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:51.114513 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:51.128736 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2f0a-edc3-463d-b963-c690aadc226f service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:51.134088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:51.135091 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:51.135446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:51.135796 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] PATH_INFO: `/v3/projects/db8e185ada244c87abf547339f3caf8b/users/70537fd5ffd84a5592003bc7f7eb8315/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:51.160835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8e185ada244c87abf547339f3caf8b, user_id=70537fd5ffd84a5592003bc7f7eb8315, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:51.165403 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:51.197033 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1333/2638] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:51 2022] PUT /identity/v3/projects/db8e185ada244c87abf547339f3caf8b/users/70537fd5ffd84a5592003bc7f7eb8315/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:51.200602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:51.201078 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:51.201596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:51.245051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] MFA Rules not processed for user `70537fd5ffd84a5592003bc7f7eb8315`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:51.246536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:51.375136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1306/2639] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:51.391035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:51.393769 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:51.481298 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab071-7ed7-40fe-923e-ecbeef0a8e48 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:51.486246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca619f9-f5e1-4273-a725-ad9ab780dbc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:51.486926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca619f9-f5e1-4273-a725-ad9ab780dbc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:51.487249 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca619f9-f5e1-4273-a725-ad9ab780dbc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:51.488166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca619f9-f5e1-4273-a725-ad9ab780dbc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:51.499597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca619f9-f5e1-4273-a725-ad9ab780dbc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:51.501220 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca619f9-f5e1-4273-a725-ad9ab780dbc1 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:51.512547 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1334/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:51.768526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:51.770397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:51.939652 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85b87-4d36-4d9a-a647-588a924f9d8a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:51.958286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:51.960086 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:51.960381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:51.960659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] PATH_INFO: `/v3/projects/a13b0b98394248d6bd5c12a6780bc71d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:51.965851 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13b0b98394248d6bd5c12a6780bc71d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:51.967818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.054837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13b0b98394248d6bd5c12a6780bc71d', 'request_id': 'req-75abb79a-ae90-493e-ab9a-050fef9d3037'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:52.068178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13b0b98394248d6bd5c12a6780bc71d', 'request_id': 'req-75abb79a-ae90-493e-ab9a-050fef9d3037'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:52.076312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13b0b98394248d6bd5c12a6780bc71d', 'request_id': 'req-75abb79a-ae90-493e-ab9a-050fef9d3037'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:52.088863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] The token cache is being invalidate because project a13b0b98394248d6bd5c12a6780bc71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:16:52.099503 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:52.102594 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-75abb79a-ae90-493e-ab9a-050fef9d3037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:16:52.108252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1307/2641] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:16:51 2022] DELETE /identity/v3/projects/a13b0b98394248d6bd5c12a6780bc71d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:52.113752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.114258 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.114366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.151423 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:52.152855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:52.237835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1335/2642] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:52.241230 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.241721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.241833 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.262537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:52.264103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:52.281881 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1308/2643] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:16:52.282698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.294347 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fbf36-17b7-4047-994f-721f549a2597 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.299984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.301454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.302081 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.302534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.303853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:16:52.304167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.305924 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.330182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1336/2644] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 14:16:52.334598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.347825 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dfe47-c7e2-4178-9900-b3a0ad8d4622 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.355892 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.357285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.357619 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.357883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.359682 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.361910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.412187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1309/2645] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:16:52 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:52.416434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.437463 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09347d-474f-44f8-a85f-7f9eac56dfd9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.556815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.557830 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.558270 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.558699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.559806 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.562140 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.594988 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1337/2646] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:16:52 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:16:52.599580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.611272 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a3b20-ca8c-4b07-abe1-94b7524dda13 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.626762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.627964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.628196 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.628479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.629482 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.631238 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.643531 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1310/2647] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:52.647648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.657844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b68dd-98a4-4606-a65d-3f1f87d92b1e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.663593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac363a19-4853-4524-830c-201b778b2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.664360 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac363a19-4853-4524-830c-201b778b2e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.664705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac363a19-4853-4524-830c-201b778b2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.665041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac363a19-4853-4524-830c-201b778b2e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.666004 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac363a19-4853-4524-830c-201b778b2e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.667662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac363a19-4853-4524-830c-201b778b2e65 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.679482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1338/2648] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:16:52.684148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.694929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3ca2-2048-4679-93c2-e25b03191f6e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.702211 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.703164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.703449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.703744 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] PATH_INFO: `/v3/projects/d9f13b89c28046179f245681c1a70cf8/users/fdd5e8ef646b42e5b4f5cf9e2b2b746b/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.721010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f13b89c28046179f245681c1a70cf8, user_id=fdd5e8ef646b42e5b4f5cf9e2b2b746b, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.724568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.740041 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1311/2649] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:16:52 2022] PUT /identity/v3/projects/d9f13b89c28046179f245681c1a70cf8/users/fdd5e8ef646b42e5b4f5cf9e2b2b746b/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:16:52.748207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be816-2c91-46e2-abe0-f52b46c2f618 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.748207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be816-2c91-46e2-abe0-f52b46c2f618 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.748207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be816-2c91-46e2-abe0-f52b46c2f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.769613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ee2be816-2c91-46e2-abe0-f52b46c2f618 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:52.769613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ee2be816-2c91-46e2-abe0-f52b46c2f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:52.851043 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1339/2650] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:52.861024 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:52.862865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:52.922989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07156-3569-49aa-9902-84b8e891db23 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:52.926985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:52.927727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:52.928030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:52.928304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:52.937713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:52.939158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:52.952559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1312/2651] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:54.029820 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dbc2d-3c48-489a-8c5b-c2d85716f52e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:54.030906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dbc2d-3c48-489a-8c5b-c2d85716f52e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:54.030906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dbc2d-3c48-489a-8c5b-c2d85716f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:54.064581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f60dbc2d-3c48-489a-8c5b-c2d85716f52e None None] MFA Rules not processed for user `fdd5e8ef646b42e5b4f5cf9e2b2b746b`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:54.066042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f60dbc2d-3c48-489a-8c5b-c2d85716f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:54.151592 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1340/2652] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:54.163994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:16:54.166197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:54.232360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714997d6-ba82-4242-b9ee-e55cbc3f195e service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:16:54.235973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fc022-0606-418a-9116-c5b851a5ede4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:16:54.236621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc022-0606-418a-9116-c5b851a5ede4 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:54.236902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc022-0606-418a-9116-c5b851a5ede4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:54.237178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc022-0606-418a-9116-c5b851a5ede4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:54.246458 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fc022-0606-418a-9116-c5b851a5ede4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:16:54.247899 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fc022-0606-418a-9116-c5b851a5ede4 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:16:54.269925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1313/2653] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:16:55.234199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:55.234710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:55.234826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:55.254477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] MFA Rules not processed for user `5a07a92c35e84b0084c2a96263897e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:55.255708 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:55.312517 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1341/2654] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:16:57.797958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4ea3a-be95-482e-b360-18d5926e6560 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:16:57.798519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4ea3a-be95-482e-b360-18d5926e6560 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:16:57.798925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4ea3a-be95-482e-b360-18d5926e6560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:16:57.817253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-44f4ea3a-be95-482e-b360-18d5926e6560 None None] MFA Rules not processed for user `fdd5e8ef646b42e5b4f5cf9e2b2b746b`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:16:57.819026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-44f4ea3a-be95-482e-b360-18d5926e6560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:16:57.832163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1314/2655] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:17:00.301987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:00.304007 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:00.317521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573cde3-e648-46a9-ae6b-25f99e371bc7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:00.324731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:00.325671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:00.325953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:00.326250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] PATH_INFO: `/v3/users/70537fd5ffd84a5592003bc7f7eb8315` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:00.327565 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70537fd5ffd84a5592003bc7f7eb8315)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:00.329606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:00.381309 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70537fd5ffd84a5592003bc7f7eb8315'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:00.393241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70537fd5ffd84a5592003bc7f7eb8315'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:00.402231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70537fd5ffd84a5592003bc7f7eb8315'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:00.403031 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70537fd5ffd84a5592003bc7f7eb8315'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:00.412604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70537fd5ffd84a5592003bc7f7eb8315'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:00.420960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1342/2656] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:00 2022] DELETE /identity/v3/users/70537fd5ffd84a5592003bc7f7eb8315 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:00.425431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:00.425985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:00.426102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:00.446087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:00.447243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:00.513220 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1315/2657] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:00.523675 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:00.525272 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:00.585727 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3cd3a-f146-458f-930c-075c4c51faf6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:00.589659 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e04f4-078b-4c9a-a542-002da7015a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:00.590314 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e04f4-078b-4c9a-a542-002da7015a70 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:00.590590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e04f4-078b-4c9a-a542-002da7015a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:00.590861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e04f4-078b-4c9a-a542-002da7015a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:00.600439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e04f4-078b-4c9a-a542-002da7015a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:00.601985 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e04f4-078b-4c9a-a542-002da7015a70 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:00.612521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1343/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:01.389982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.391902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:01.407025 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f57c1-230c-40ea-a65b-97d85f5b0c1a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.413781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.414795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.415159 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.415529 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] PATH_INFO: `/v3/projects/db8e185ada244c87abf547339f3caf8b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.417182 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8e185ada244c87abf547339f3caf8b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.419344 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.488609 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8e185ada244c87abf547339f3caf8b', 'request_id': 'req-edcc2db6-92fe-4397-82e1-b0307afef876'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:01.499293 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8e185ada244c87abf547339f3caf8b', 'request_id': 'req-edcc2db6-92fe-4397-82e1-b0307afef876'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:01.508143 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8e185ada244c87abf547339f3caf8b', 'request_id': 'req-edcc2db6-92fe-4397-82e1-b0307afef876'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:01.521906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] The token cache is being invalidate because project db8e185ada244c87abf547339f3caf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:01.522318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:01.523625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-edcc2db6-92fe-4397-82e1-b0307afef876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:01.525766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1316/2659] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:01 2022] DELETE /identity/v3/projects/db8e185ada244c87abf547339f3caf8b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:01.530598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.531079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.531177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.548527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:01.549868 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:01.614332 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1344/2660] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:17:01.622605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.623177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.624074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.644783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:01.646153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:01.657519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1317/2661] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:01.661290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.671739 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d3925-44d2-4f3a-8259-b8112ae7ccd2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.676581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.677377 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.678076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.678459 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.679885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:17:01.680299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.682336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.699011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1345/2662] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:17:01.702288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.714054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dcc4c-21f2-48b0-a7e6-8e0ff183e6f4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.718931 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.719700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.720190 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.720467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.721154 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.723114 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.749397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1318/2663] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:01.754067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.764536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c986-6300-490e-82d0-ad3937577cb8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.819948 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.820626 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.820930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.821200 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.821910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.823801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.851496 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1346/2664] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:17:01 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:01.856414 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.867229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddbde5-9cd3-4a95-b3bc-db072ad46d53 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.871965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.872628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.872912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.873185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.873944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.875536 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.887335 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1319/2665] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:01.894318 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.904746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1654e8d-19ce-4409-b8ca-1500356b98d9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.910149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90396127-537a-453b-9121-5e81b0435aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.910814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396127-537a-453b-9121-5e81b0435aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.911261 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396127-537a-453b-9121-5e81b0435aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.911538 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396127-537a-453b-9121-5e81b0435aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.912306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90396127-537a-453b-9121-5e81b0435aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.913935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90396127-537a-453b-9121-5e81b0435aa9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.924284 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1347/2666] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:01.929260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:01.939559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad63d0-b0e8-402c-94f3-2014e6f16e7c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:01.945298 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:01.946312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.946506 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.946795 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] PATH_INFO: `/v3/projects/48b43d6b15ea406daf87cca672ec308f/users/34e3680b5aff4853a92a8a8c92f6ab63/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:01.962181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b43d6b15ea406daf87cca672ec308f, user_id=34e3680b5aff4853a92a8a8c92f6ab63, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:01.964818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:01.985592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1320/2667] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:01 2022] PUT /identity/v3/projects/48b43d6b15ea406daf87cca672ec308f/users/34e3680b5aff4853a92a8a8c92f6ab63/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:01.996122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:01.996435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:01.997064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.024020 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] MFA Rules not processed for user `34e3680b5aff4853a92a8a8c92f6ab63`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:02.025219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:02.091465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1348/2668] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:02.098103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.164688 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed417c76-356f-46f3-ae56-3ae1d151e544 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.169946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.170638 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.170918 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.171194 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.172502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.174462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.205449 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1321/2669] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:02.207393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.218271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fd57-5947-4429-8dc7-5f66d09e5b15 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.279558 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.280238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.280520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.280790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.281486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.283500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.308834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1349/2670] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:17:02 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:02.313252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.329179 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98803d-982f-4192-bab0-bb1465099885 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.335085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.336390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.336839 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.337149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.338084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.339961 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.353490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1322/2671] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:02.357876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.371294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70d67-c5a5-42fe-ac48-0f46a1b5ca84 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.377278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8924bd-e013-4bba-a863-a74e642d1590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.378209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8924bd-e013-4bba-a863-a74e642d1590 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.378555 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8924bd-e013-4bba-a863-a74e642d1590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.378914 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8924bd-e013-4bba-a863-a74e642d1590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.379835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8924bd-e013-4bba-a863-a74e642d1590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.381593 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8924bd-e013-4bba-a863-a74e642d1590 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.397577 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.408790 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1350/2672] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:02.409739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9ca30-048e-4ef7-a605-a89e3eb5a24b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.418151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.419659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.419938 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.420225 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] PATH_INFO: `/v3/projects/01691d6b03684b9aa619f013bf981eda/users/f3967a552fa444068f9466f04e34d71e/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.440181 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01691d6b03684b9aa619f013bf981eda, user_id=f3967a552fa444068f9466f04e34d71e, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.443671 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.480183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.480807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.481449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.490850 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1323/2673] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:02 2022] PUT /identity/v3/projects/01691d6b03684b9aa619f013bf981eda/users/f3967a552fa444068f9466f04e34d71e/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:17:02.519144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] MFA Rules not processed for user `f3967a552fa444068f9466f04e34d71e`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:02.521572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:02.601370 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1351/2674] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:02.605989 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.676701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f0c5c-3b86-431c-be89-b1b9d13958d1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.683306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.683306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.683306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.683306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.684762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.686802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.717733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1324/2675] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:17:02.720963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.733936 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a2f4-2012-4cdc-9dd0-761eea82f1d8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.803171 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.804416 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.805106 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.805818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.806984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.811810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.845917 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1352/2676] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:17:02 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:02.847014 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.869460 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb1607-0d09-4601-a279-7e14c33be74d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.874383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.875084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.875368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.875640 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.876366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.878137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.891094 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1325/2677] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:17:02.895652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.908472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc326ea3-a956-4c80-8f98-e6daf3ef10cc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:02.918344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:02.919313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:02.919543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:02.919815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] PATH_INFO: `/v3/projects/331dac6cba784544bbbaf3be46ebc8e6/users/0ca2b0a3e1cb41fdab7ed37b99f74808/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:02.938076 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331dac6cba784544bbbaf3be46ebc8e6, user_id=0ca2b0a3e1cb41fdab7ed37b99f74808, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:02.942631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:02.957688 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1353/2678] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:02 2022] PUT /identity/v3/projects/331dac6cba784544bbbaf3be46ebc8e6/users/0ca2b0a3e1cb41fdab7ed37b99f74808/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:02.962470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:02.973453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a6da-8d35-44e1-afab-2fa5fb4ba880 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:03.034034 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7fcc-6c48-4927-b685-a2aa844ef63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:03.034701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7fcc-6c48-4927-b685-a2aa844ef63d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:03.034982 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7fcc-6c48-4927-b685-a2aa844ef63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:03.035279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7fcc-6c48-4927-b685-a2aa844ef63d admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:03.036022 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7fcc-6c48-4927-b685-a2aa844ef63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:03.037659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7fcc-6c48-4927-b685-a2aa844ef63d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:03.047153 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1326/2679] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:17:03.051507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:03.061617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5e0da-db9e-4e37-8e25-485ae2d63cb4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:03.066121 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:03.067025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:03.067302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:03.067572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] PATH_INFO: `/v3/projects/331dac6cba784544bbbaf3be46ebc8e6/users/0ca2b0a3e1cb41fdab7ed37b99f74808/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:03.070146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331dac6cba784544bbbaf3be46ebc8e6, user_id=0ca2b0a3e1cb41fdab7ed37b99f74808, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:03.072758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:03.082687 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1354/2680] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:03 2022] PUT /identity/v3/projects/331dac6cba784544bbbaf3be46ebc8e6/users/0ca2b0a3e1cb41fdab7ed37b99f74808/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:03.093796 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:03.094084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:03.094362 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:03.122206 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] MFA Rules not processed for user `0ca2b0a3e1cb41fdab7ed37b99f74808`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:03.123462 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:03.193727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1327/2681] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:03.204477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:03.206252 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:03.270126 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9dcd7-f479-47c8-89a6-3de07ce19201 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:03.274353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:03.274996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:03.275290 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:03.275553 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:03.334551 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:03.336110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:03.345150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1355/2682] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:04.819426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:04.821158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:04.834509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce9144-c72c-4840-8ac0-2e74a43f9282 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:04.837913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:04.838560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:04.838861 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:04.839137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:04.909101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:04.910580 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:04.920297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1328/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:05.479012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:05.488037 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e031c5-6284-45e6-964b-775633a24839 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:05.492499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369fb32-3310-4bc5-ae6f-6b0ff143b015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:05.493269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369fb32-3310-4bc5-ae6f-6b0ff143b015 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:05.493650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369fb32-3310-4bc5-ae6f-6b0ff143b015 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:05.493996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369fb32-3310-4bc5-ae6f-6b0ff143b015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:05.503661 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369fb32-3310-4bc5-ae6f-6b0ff143b015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:05.505093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369fb32-3310-4bc5-ae6f-6b0ff143b015 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:05.514818 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1356/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:09.900854 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:09.966395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413b390-9480-46d0-84cd-00eb70315cbf service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:09.970964 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:09.971838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:09.972122 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:09.972395 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] PATH_INFO: `/v3/users/34e3680b5aff4853a92a8a8c92f6ab63` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:09.973644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e3680b5aff4853a92a8a8c92f6ab63)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:09.975633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:10.025875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e3680b5aff4853a92a8a8c92f6ab63'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.037441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e3680b5aff4853a92a8a8c92f6ab63'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.038254 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e3680b5aff4853a92a8a8c92f6ab63'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.044914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e3680b5aff4853a92a8a8c92f6ab63'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.052589 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e3680b5aff4853a92a8a8c92f6ab63'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.058745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1329/2685] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:09 2022] DELETE /identity/v3/users/34e3680b5aff4853a92a8a8c92f6ab63 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:10.063340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:10.063807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:10.064039 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:10.081819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:10.083660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:10.142662 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1357/2686] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:10.152711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:10.154138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:10.210736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fc20a-d987-4556-bafa-da6e55b84016 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:10.214623 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:10.215276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:10.215599 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:10.215882 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:10.225808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:10.227178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:10.237789 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1330/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:10.542998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:10.544521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:10.559443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ba4a2-95b9-4f9f-9aee-80128b66cadd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:10.564642 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:10.565549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:10.568673 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:10.568958 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] PATH_INFO: `/v3/projects/48b43d6b15ea406daf87cca672ec308f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:10.570638 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b43d6b15ea406daf87cca672ec308f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:10.572726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:10.577246 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:10.578776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:10.625163 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b43d6b15ea406daf87cca672ec308f', 'request_id': 'req-a8310884-5ddb-4333-a595-857b750c4659'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.636349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b43d6b15ea406daf87cca672ec308f', 'request_id': 'req-a8310884-5ddb-4333-a595-857b750c4659'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.643761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b43d6b15ea406daf87cca672ec308f', 'request_id': 'req-a8310884-5ddb-4333-a595-857b750c4659'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.656362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] The token cache is being invalidate because project 48b43d6b15ea406daf87cca672ec308f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:10.656766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.657452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.659466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1358/2688] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:10 2022] DELETE /identity/v3/projects/48b43d6b15ea406daf87cca672ec308f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:10.661219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148524a4-a95f-4dfa-a695-d73bd854a4ec service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:10.664183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:10.665545 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:10.736507 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:10.736866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310884-5ddb-4333-a595-857b750c4659 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:10.737072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:10.737485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:10.737730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:10.740103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:10.741634 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:10.742501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:10.742782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:10.743047 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] PATH_INFO: `/v3/users/f3967a552fa444068f9466f04e34d71e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:10.744466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3967a552fa444068f9466f04e34d71e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:10.746539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:10.810773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3967a552fa444068f9466f04e34d71e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.813363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:10.815245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:10.825265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3967a552fa444068f9466f04e34d71e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.826676 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1331/2689] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:17:10.834892 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3967a552fa444068f9466f04e34d71e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.835777 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3967a552fa444068f9466f04e34d71e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.844975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3967a552fa444068f9466f04e34d71e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:10.851998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1359/2690] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:10 2022] DELETE /identity/v3/users/f3967a552fa444068f9466f04e34d71e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:11.537791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:11.559054 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01c135-3397-4dca-b286-0fe8b0f70d65 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:11.664084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:11.665316 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:11.665785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:11.666315 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] PATH_INFO: `/v3/projects/01691d6b03684b9aa619f013bf981eda` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:11.668540 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01691d6b03684b9aa619f013bf981eda)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:11.671007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:11.741467 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01691d6b03684b9aa619f013bf981eda', 'request_id': 'req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:11.758062 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01691d6b03684b9aa619f013bf981eda', 'request_id': 'req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:11.776081 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01691d6b03684b9aa619f013bf981eda', 'request_id': 'req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:11.796819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] The token cache is being invalidate because project 01691d6b03684b9aa619f013bf981eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:11.797338 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:11.798401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:11.800549 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1332/2691] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:11 2022] DELETE /identity/v3/projects/01691d6b03684b9aa619f013bf981eda => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:11.806156 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:11.808522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:11.828910 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a3b7-4fb1-479d-8c7a-a5d8c0e2c143 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:11.921135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:11.922124 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:11.922344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:11.922815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] PATH_INFO: `/v3/users/0ca2b0a3e1cb41fdab7ed37b99f74808` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:11.927351 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca2b0a3e1cb41fdab7ed37b99f74808)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:11.929590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:12.036752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca2b0a3e1cb41fdab7ed37b99f74808'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.062536 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca2b0a3e1cb41fdab7ed37b99f74808'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.081749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca2b0a3e1cb41fdab7ed37b99f74808'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.082635 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca2b0a3e1cb41fdab7ed37b99f74808'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.105208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-73d88a2b-a70d-46eb-90c4-fb76f30ae788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca2b0a3e1cb41fdab7ed37b99f74808'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.119011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1360/2692] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:11 2022] DELETE /identity/v3/users/0ca2b0a3e1cb41fdab7ed37b99f74808 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:12.473138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:12.474650 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:12.508428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ec64-052d-4f1f-aea4-dc4fe5f9c39c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:12.591699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:12.592583 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:12.592865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:12.593140 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] PATH_INFO: `/v3/projects/331dac6cba784544bbbaf3be46ebc8e6` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:12.594481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331dac6cba784544bbbaf3be46ebc8e6)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:12.596477 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:12.650818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331dac6cba784544bbbaf3be46ebc8e6', 'request_id': 'req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.663994 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331dac6cba784544bbbaf3be46ebc8e6', 'request_id': 'req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.679783 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331dac6cba784544bbbaf3be46ebc8e6', 'request_id': 'req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.693832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] The token cache is being invalidate because project 331dac6cba784544bbbaf3be46ebc8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:12.694232 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.694911 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9324c139-e33f-4b3f-93e9-944d2f5cf3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:12.698697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1333/2693] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:12 2022] DELETE /identity/v3/projects/331dac6cba784544bbbaf3be46ebc8e6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:12.704713 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:12.705099 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:12.705486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:12.732645 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:12.734429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:12.808268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1361/2694] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:12.817522 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:12.817769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:12.818044 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:12.839200 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:12.840591 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:12.856154 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:12.857055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1334/2695] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:12.867074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010468d-6165-424a-a653-115ab3cff2a5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:12.872114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:12.873315 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:12.873629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:12.873907 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:12.874853 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:17:12.875217 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:12.877035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:12.889184 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1362/2696] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:17:12.893876 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:12.906294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b08a-c86f-4698-8aa9-160b0206411e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:12.912269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:12.912939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:12.913219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:12.913600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:12.914334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:12.917627 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:12.951811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1335/2697] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:17:12 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:12.953292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:12.963885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840541d-6642-42d4-8e9a-7ab104a43edc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:13.024208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:13.024897 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.025174 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.025446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.026192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:13.028224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:13.051055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1363/2698] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:17:12 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:13.055755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:13.066925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0221-c3da-43d5-9aa9-cf27313a594a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:13.072180 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:13.072811 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.073093 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.073370 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.074137 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:13.076059 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:13.088757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1336/2699] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:13.092891 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:13.117164 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed056-cb78-4935-8cc7-13a08eff8796 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:13.124383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd331757-029b-4913-af85-48c436ebdd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:13.125297 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd331757-029b-4913-af85-48c436ebdd84 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.125787 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd331757-029b-4913-af85-48c436ebdd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.126343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd331757-029b-4913-af85-48c436ebdd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.127253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd331757-029b-4913-af85-48c436ebdd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:13.129012 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd331757-029b-4913-af85-48c436ebdd84 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:13.142079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1364/2700] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:13.146962 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:13.159443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe092-3b3e-4815-a868-c276aa8ffef3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:13.165472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:13.166518 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.166877 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.167245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] PATH_INFO: `/v3/projects/ce216acb83ac41eca44c28c88925c59b/users/7b94cdeb90d042858c73688acadb4cd1/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.185192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce216acb83ac41eca44c28c88925c59b, user_id=7b94cdeb90d042858c73688acadb4cd1, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:13.188318 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:13.206197 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1337/2701] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:13 2022] PUT /identity/v3/projects/ce216acb83ac41eca44c28c88925c59b/users/7b94cdeb90d042858c73688acadb4cd1/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:17:13.217396 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.217761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.218011 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.252540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] MFA Rules not processed for user `7b94cdeb90d042858c73688acadb4cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:13.253886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:13.332737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1365/2702] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:13.347582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:13.350454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:13.430678 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c36cb-57de-4a01-bd26-b010ca1869e9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:13.436098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:13.436098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.436098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.436098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.447890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:13.450403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:13.461863 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1338/2703] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:13.655782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:13.657951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:13.764872 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6089-db0c-4387-99be-c0dd8fea8777 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:13.768983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:13.770118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:13.770505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:13.770846 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:13.773526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:13.859815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:13.863544 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c63616-f34e-4bd2-80b7-1d9d3c5f1817 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:13.876327 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1366/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:16.175278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:16.187103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64cd8-714f-46b4-82c4-b9b7278290bf service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:16.196766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:16.197690 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:16.198986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:16.198986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] PATH_INFO: `/v3/users/7b94cdeb90d042858c73688acadb4cd1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:16.199567 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b94cdeb90d042858c73688acadb4cd1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:16.201524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:16.273016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b94cdeb90d042858c73688acadb4cd1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.285397 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b94cdeb90d042858c73688acadb4cd1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.286475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b94cdeb90d042858c73688acadb4cd1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.298826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b94cdeb90d042858c73688acadb4cd1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.308367 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b94cdeb90d042858c73688acadb4cd1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.317056 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1339/2705] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:16 2022] DELETE /identity/v3/users/7b94cdeb90d042858c73688acadb4cd1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:16.322591 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:16.323159 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:16.323767 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:16.346330 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:16.347595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:16.432155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1367/2706] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:16.444242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:16.447157 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:16.519871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d579a-427f-4973-bf04-5fa960eb0077 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:16.524055 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd595-06f0-49e2-8f10-55c335433cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:16.525488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd595-06f0-49e2-8f10-55c335433cac service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:16.525878 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd595-06f0-49e2-8f10-55c335433cac service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:16.526257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd595-06f0-49e2-8f10-55c335433cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:16.547781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abd595-06f0-49e2-8f10-55c335433cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:16.549505 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abd595-06f0-49e2-8f10-55c335433cac service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:16.560673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1340/2707] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:16.865941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:16.867475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:16.881989 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33657b83-cf6f-4e4a-a984-1c13210825e3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:16.887834 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:16.888930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:16.889259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:16.889483 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] PATH_INFO: `/v3/projects/ce216acb83ac41eca44c28c88925c59b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:16.890724 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce216acb83ac41eca44c28c88925c59b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:16.899802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:16.956801 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce216acb83ac41eca44c28c88925c59b', 'request_id': 'req-e19a48de-5258-46d0-aaca-b10a2323cb15'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.975356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce216acb83ac41eca44c28c88925c59b', 'request_id': 'req-e19a48de-5258-46d0-aaca-b10a2323cb15'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.983447 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce216acb83ac41eca44c28c88925c59b', 'request_id': 'req-e19a48de-5258-46d0-aaca-b10a2323cb15'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.995273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] The token cache is being invalidate because project ce216acb83ac41eca44c28c88925c59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:16.995477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.996083 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e19a48de-5258-46d0-aaca-b10a2323cb15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:16.997951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1368/2708] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:16 2022] DELETE /identity/v3/projects/ce216acb83ac41eca44c28c88925c59b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:17.002661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.002945 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.003223 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.021003 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:17.022865 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:17.108445 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1341/2709] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:17.117013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.117324 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.117647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.137401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:17.138778 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:17.152000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1369/2710] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:17.153453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.166339 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd108fbe-7f6f-4d21-8564-0b2fd2dcba9a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.171365 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.172836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.172836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.173147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.173908 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:17:17.174311 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.176040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.190053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1342/2711] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:17:17.195465 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.205789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37b34d-9424-4d70-a0de-ceba1ccb50d3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.211322 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.211991 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.212274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.212549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.213239 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.215209 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.252072 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1370/2712] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:17:17 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:17.256331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.269265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f76e64-b467-427a-8909-fbe9285e76a6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.330276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.331253 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.331717 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.332148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.333101 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.335978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.365714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1343/2713] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:17:17 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:17:17.367224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.377596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a6c8-c0b5-468a-a563-a4d547522da7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.383146 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.384025 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.384497 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.384933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.385842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.387705 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.400275 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1371/2714] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:17.404289 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.414749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4fdef-7f58-4a94-8f8b-3cf3dcd8cd24 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.419415 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003319cb-0553-414a-9c72-dd8e24b8d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.420030 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003319cb-0553-414a-9c72-dd8e24b8d554 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.420314 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003319cb-0553-414a-9c72-dd8e24b8d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.420590 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003319cb-0553-414a-9c72-dd8e24b8d554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.421312 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003319cb-0553-414a-9c72-dd8e24b8d554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.423065 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003319cb-0553-414a-9c72-dd8e24b8d554 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.436091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1344/2715] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:17.440122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.450415 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33d70-bff1-42ac-9a01-499bb984c449 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.460150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.461598 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.461893 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.462166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] PATH_INFO: `/v3/projects/577dc79c054e4267b43eeb4d52e9f406/users/88b71c2ac12742cc90f5f0d01731f79f/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.486599 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577dc79c054e4267b43eeb4d52e9f406, user_id=88b71c2ac12742cc90f5f0d01731f79f, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.490427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.511369 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1372/2716] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:17 2022] PUT /identity/v3/projects/577dc79c054e4267b43eeb4d52e9f406/users/88b71c2ac12742cc90f5f0d01731f79f/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:17.522738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.523026 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.523330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.575117 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] MFA Rules not processed for user `88b71c2ac12742cc90f5f0d01731f79f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:17.576363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:17.683845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1345/2717] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:17.695602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:17.698087 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:17.778590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc78db-1904-440f-a7c1-22af74b03a76 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:17.782860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:17.783624 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:17.783978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:17.784376 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:17.806215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:17.807766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:17.826735 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1373/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:21.306751 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:21.310871 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:21.376919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd60b0-036f-4e40-9f49-ec2b8cad77db None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:21.381430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:21.382579 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:21.382859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:21.383130 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] PATH_INFO: `/v3/users/400f5f9cb30d4cd380913684bc0bb6ff` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:21.384321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=400f5f9cb30d4cd380913684bc0bb6ff)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:21.386277 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:21.432189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400f5f9cb30d4cd380913684bc0bb6ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.444933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400f5f9cb30d4cd380913684bc0bb6ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.445696 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400f5f9cb30d4cd380913684bc0bb6ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.452510 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400f5f9cb30d4cd380913684bc0bb6ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.460379 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400f5f9cb30d4cd380913684bc0bb6ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.466247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1346/2719] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:21 2022] DELETE /identity/v3/users/400f5f9cb30d4cd380913684bc0bb6ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:21.651371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:21.664232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c5dd2-18b2-4905-a0da-591dafacc44d service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:21.731292 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:21.732301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:21.732628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:21.732879 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] PATH_INFO: `/v3/projects/41237bb81ade44018b1ef1781e00db45` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:21.734102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41237bb81ade44018b1ef1781e00db45)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:21.736046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:21.784779 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41237bb81ade44018b1ef1781e00db45', 'request_id': 'req-fd9495e3-3b27-42c9-b456-d13125227988'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.793482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41237bb81ade44018b1ef1781e00db45', 'request_id': 'req-fd9495e3-3b27-42c9-b456-d13125227988'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.801452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41237bb81ade44018b1ef1781e00db45', 'request_id': 'req-fd9495e3-3b27-42c9-b456-d13125227988'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.812456 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] The token cache is being invalidate because project 41237bb81ade44018b1ef1781e00db45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:21.812746 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.813399 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.814987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1374/2720] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:21 2022] DELETE /identity/v3/projects/41237bb81ade44018b1ef1781e00db45 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:21.819810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:21.821221 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:21.834901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7ce9-7b95-4d69-bcd1-b8b5368cc43b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:21.893444 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:21.894351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:21.894633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:21.894913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] PATH_INFO: `/v3/users/d2e7836ed9dc41908debe0760f49685f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:21.896355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e7836ed9dc41908debe0760f49685f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:21.898620 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:21.948070 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e7836ed9dc41908debe0760f49685f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.959164 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e7836ed9dc41908debe0760f49685f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.959810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e7836ed9dc41908debe0760f49685f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.966621 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e7836ed9dc41908debe0760f49685f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.976218 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e7836ed9dc41908debe0760f49685f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:21.982490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1347/2721] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:21 2022] DELETE /identity/v3/users/d2e7836ed9dc41908debe0760f49685f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:17:22.164726 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:22.166276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:22.179838 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9495e3-3b27-42c9-b456-d13125227988 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:22.238433 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:22.239325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:22.239606 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:22.239906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] PATH_INFO: `/v3/projects/24b376b48e6945ab85ce319896d4a296` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:22.241162 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b376b48e6945ab85ce319896d4a296)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:22.243115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:22.289656 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b376b48e6945ab85ce319896d4a296', 'request_id': 'req-588560da-f3a3-4617-9555-00110bc9b226'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:22.298888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b376b48e6945ab85ce319896d4a296', 'request_id': 'req-588560da-f3a3-4617-9555-00110bc9b226'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:22.305955 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b376b48e6945ab85ce319896d4a296', 'request_id': 'req-588560da-f3a3-4617-9555-00110bc9b226'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:22.317780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] The token cache is being invalidate because project 24b376b48e6945ab85ce319896d4a296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:22.318236 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:22.319136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-588560da-f3a3-4617-9555-00110bc9b226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:22.320922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1375/2722] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:22 2022] DELETE /identity/v3/projects/24b376b48e6945ab85ce319896d4a296 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:17:37.337837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:37.339476 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:37.355121 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e19bb3-aa22-4c58-b11e-a6904933f540 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:37.422812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:37.423702 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:37.423985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:37.424257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] PATH_INFO: `/v3/users/88b71c2ac12742cc90f5f0d01731f79f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:37.425489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b71c2ac12742cc90f5f0d01731f79f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:37.427459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:37.473279 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b71c2ac12742cc90f5f0d01731f79f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:37.485001 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b71c2ac12742cc90f5f0d01731f79f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:37.485706 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b71c2ac12742cc90f5f0d01731f79f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:37.493108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b71c2ac12742cc90f5f0d01731f79f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:37.500400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b71c2ac12742cc90f5f0d01731f79f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:37.507485 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1348/2723] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:37 2022] DELETE /identity/v3/users/88b71c2ac12742cc90f5f0d01731f79f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:37.512208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:37.512682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:37.512781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:37.531062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:37.532733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:37.594770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1376/2724] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:37.606294 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:37.607769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:37.666966 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193fe9e-33d5-4012-8b4f-18e4d333c06f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:37.670685 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2a799-87c5-4f69-9e28-690898610bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:37.671340 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2a799-87c5-4f69-9e28-690898610bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:37.671628 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2a799-87c5-4f69-9e28-690898610bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:37.671906 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2a799-87c5-4f69-9e28-690898610bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:37.682371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2a799-87c5-4f69-9e28-690898610bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:37.683903 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2a799-87c5-4f69-9e28-690898610bf5 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:37.693715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1349/2725] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:37.967770 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:37.969278 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:37.983273 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b765a28-9499-41df-826c-dc46e487c1e2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:37.988494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:37.989343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:37.989653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:37.989927 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] PATH_INFO: `/v3/projects/577dc79c054e4267b43eeb4d52e9f406` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:37.991170 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] RBAC: Authorizing `identity:delete_project(project_id=577dc79c054e4267b43eeb4d52e9f406)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:37.993203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.053765 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577dc79c054e4267b43eeb4d52e9f406', 'request_id': 'req-a8f924b1-e52d-4597-a91f-9f194c2460da'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:38.062058 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577dc79c054e4267b43eeb4d52e9f406', 'request_id': 'req-a8f924b1-e52d-4597-a91f-9f194c2460da'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:38.068759 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577dc79c054e4267b43eeb4d52e9f406', 'request_id': 'req-a8f924b1-e52d-4597-a91f-9f194c2460da'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:38.080118 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] The token cache is being invalidate because project 577dc79c054e4267b43eeb4d52e9f406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:38.080401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:38.081080 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a8f924b1-e52d-4597-a91f-9f194c2460da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:38.082670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1377/2726] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:37 2022] DELETE /identity/v3/projects/577dc79c054e4267b43eeb4d52e9f406 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:17:38.088131 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.088495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.088844 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.109403 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:38.110680 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:38.169393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1350/2727] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:38.177131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.177414 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.177722 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.196486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:38.197628 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:38.205445 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1378/2728] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:38.209838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.220481 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e06c3-c032-4340-b9e8-003cf16f416d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.225090 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.225779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.226067 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.226353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.227074 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:17:38.227383 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.228975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.241189 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1351/2729] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:17:38.245241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.255540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abca24-5d1a-4c0a-90ce-2402f896d6c2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.260795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.261450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.261768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.262046 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.262782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.264698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.292055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1379/2730] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:17:38 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:38.296728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.306791 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c71d-ca83-4f64-b477-fbb3fe66ae31 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.362286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.362952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.363207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.363484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.364186 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.366345 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.391635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1352/2731] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:17:38 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:17:38.392844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.404660 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201d6f1-3d89-4328-a860-8f2690744059 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.409616 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.410279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.410557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.410829 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.411600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.413274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.424826 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1380/2732] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:38.428967 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.439011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fd16-0416-4069-85f6-305faa5aea96 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.443669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5968c-48dd-4dcf-a2f3-5f1e10cc38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.444885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5968c-48dd-4dcf-a2f3-5f1e10cc38c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.445166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5968c-48dd-4dcf-a2f3-5f1e10cc38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.445537 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5968c-48dd-4dcf-a2f3-5f1e10cc38c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.446281 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5968c-48dd-4dcf-a2f3-5f1e10cc38c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.447818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5968c-48dd-4dcf-a2f3-5f1e10cc38c2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.458188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1353/2733] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:17:38.463014 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.473215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f2116-012f-47af-94c2-f054d6d7b725 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.477814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.478682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.478956 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.479223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] PATH_INFO: `/v3/projects/1de7e3d285ba4b1caedcbce6349f4591/users/8c5eb2a8a23d421eb524a10cc1e27d69/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.494211 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de7e3d285ba4b1caedcbce6349f4591, user_id=8c5eb2a8a23d421eb524a10cc1e27d69, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.496870 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.510331 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1381/2734] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:17:38 2022] PUT /identity/v3/projects/1de7e3d285ba4b1caedcbce6349f4591/users/8c5eb2a8a23d421eb524a10cc1e27d69/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:38.521352 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.521670 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.521958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.548148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] MFA Rules not processed for user `8c5eb2a8a23d421eb524a10cc1e27d69`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:38.549360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:38.623813 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1354/2735] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:38.636092 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:38.637912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:38.695320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820c6b-0122-4187-8b9a-beb0a1bda5f6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:38.699045 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab0f7c-a37f-40f9-aa0e-f38fb04f2f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:38.699690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab0f7c-a37f-40f9-aa0e-f38fb04f2f3a service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:38.699971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab0f7c-a37f-40f9-aa0e-f38fb04f2f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:38.700246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab0f7c-a37f-40f9-aa0e-f38fb04f2f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:38.709030 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab0f7c-a37f-40f9-aa0e-f38fb04f2f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:38.710522 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab0f7c-a37f-40f9-aa0e-f38fb04f2f3a service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:38.719213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1382/2736] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:48.847947 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:48.918669 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9e9f7-4438-4f1b-a7c8-9748702c983b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:48.923734 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:48.924588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:48.924868 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:48.925144 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] PATH_INFO: `/v3/users/8c5eb2a8a23d421eb524a10cc1e27d69` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:48.926361 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5eb2a8a23d421eb524a10cc1e27d69)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:48.928304 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:48.978188 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5eb2a8a23d421eb524a10cc1e27d69'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:48.990242 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5eb2a8a23d421eb524a10cc1e27d69'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:48.990925 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5eb2a8a23d421eb524a10cc1e27d69'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.001371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5eb2a8a23d421eb524a10cc1e27d69'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.013006 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5eb2a8a23d421eb524a10cc1e27d69'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.021466 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1355/2737] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:17:48 2022] DELETE /identity/v3/users/8c5eb2a8a23d421eb524a10cc1e27d69 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:17:49.027467 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:49.027996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:49.028454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:49.048653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:17:49.049880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:49.117775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1383/2738] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:17:49.129343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:49.130838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:49.188010 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b58c-87b8-404c-bbc6-9e720799c923 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:49.191736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6596f-d399-48d2-bf75-36a062d3771a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:49.192380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6596f-d399-48d2-bf75-36a062d3771a service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:49.192683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6596f-d399-48d2-bf75-36a062d3771a service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:49.192937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6596f-d399-48d2-bf75-36a062d3771a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:49.202317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6596f-d399-48d2-bf75-36a062d3771a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:49.203745 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6596f-d399-48d2-bf75-36a062d3771a service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:49.214725 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1356/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:17:49.523596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:17:49.525971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:17:49.546980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec1b8a-ffc7-4794-8de0-bca1c37543da None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:17:49.554839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:17:49.556913 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:17:49.557442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:17:49.557855 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] PATH_INFO: `/v3/projects/1de7e3d285ba4b1caedcbce6349f4591` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:17:49.559518 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de7e3d285ba4b1caedcbce6349f4591)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:17:49.562363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:17:49.621520 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de7e3d285ba4b1caedcbce6349f4591', 'request_id': 'req-8e8a3d69-357f-4982-b58c-95b00905630b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.630440 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de7e3d285ba4b1caedcbce6349f4591', 'request_id': 'req-8e8a3d69-357f-4982-b58c-95b00905630b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.638149 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de7e3d285ba4b1caedcbce6349f4591', 'request_id': 'req-8e8a3d69-357f-4982-b58c-95b00905630b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.650817 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] The token cache is being invalidate because project 1de7e3d285ba4b1caedcbce6349f4591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:17:49.651094 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.651750 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8e8a3d69-357f-4982-b58c-95b00905630b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:17:49.653364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1384/2740] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:17:49 2022] DELETE /identity/v3/projects/1de7e3d285ba4b1caedcbce6349f4591 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:18:14.223625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:18:14.224203 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:18:14.224604 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:18:14.244515 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] MFA Rules not processed for user `fdd5e8ef646b42e5b4f5cf9e2b2b746b`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:18:14.246005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:18:14.303705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1357/2741] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:18:24.072584 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:18:24.073116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:18:24.073116 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:18:24.094491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] MFA Rules not processed for user `5a07a92c35e84b0084c2a96263897e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:18:24.096631 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:18:24.161131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1385/2742] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:11.300642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:11.301722 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:11.360546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19b02-f285-4571-b959-858d903e4766 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:11.364107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:11.364754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:11.365031 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:11.365303 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:11.367202 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:11.438158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:11.439639 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:11.451727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1358/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:14.566425 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:14.568716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:14.583343 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a51caf-80b3-4504-8d9f-04b8b43b9f97 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:14.589183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:14.590244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:14.590604 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:14.590983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] PATH_INFO: `/v3/users/fdd5e8ef646b42e5b4f5cf9e2b2b746b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:14.592494 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd5e8ef646b42e5b4f5cf9e2b2b746b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:14.594866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:14.686197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd5e8ef646b42e5b4f5cf9e2b2b746b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:14.711458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd5e8ef646b42e5b4f5cf9e2b2b746b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:14.724807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd5e8ef646b42e5b4f5cf9e2b2b746b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:14.726061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd5e8ef646b42e5b4f5cf9e2b2b746b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:14.740508 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd5e8ef646b42e5b4f5cf9e2b2b746b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:14.751055 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1386/2744] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:14 2022] DELETE /identity/v3/users/fdd5e8ef646b42e5b4f5cf9e2b2b746b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:14.996647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:15.017913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbdbc9-7d53-41c7-9815-37b297e2c0fa service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:15.122930 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:15.124699 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:15.125113 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:15.125534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] PATH_INFO: `/v3/projects/d9f13b89c28046179f245681c1a70cf8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:15.128331 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f13b89c28046179f245681c1a70cf8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:15.131442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:15.212350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f13b89c28046179f245681c1a70cf8', 'request_id': 'req-e9a42a65-6765-495e-bcb7-7fed6c5a830c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:15.221138 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f13b89c28046179f245681c1a70cf8', 'request_id': 'req-e9a42a65-6765-495e-bcb7-7fed6c5a830c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:15.229603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f13b89c28046179f245681c1a70cf8', 'request_id': 'req-e9a42a65-6765-495e-bcb7-7fed6c5a830c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:15.242489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] The token cache is being invalidate because project d9f13b89c28046179f245681c1a70cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:15.242803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:15.243793 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:15.245739 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1359/2745] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:14 2022] DELETE /identity/v3/projects/d9f13b89c28046179f245681c1a70cf8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:18.534269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:18.544609 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:18.557987 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57868390-0b89-42cd-974e-de07d0f4e1ec admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:18.623325 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:18.624590 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:18.624998 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:18.625271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] PATH_INFO: `/v3/users/516432654a024122987075db3f43798f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:18.626535 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516432654a024122987075db3f43798f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:18.628491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:18.675051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516432654a024122987075db3f43798f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:18.693062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516432654a024122987075db3f43798f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:18.701358 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516432654a024122987075db3f43798f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:18.702114 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516432654a024122987075db3f43798f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:18.708957 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516432654a024122987075db3f43798f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:18.714937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1387/2746] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:18 2022] DELETE /identity/v3/users/516432654a024122987075db3f43798f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:18.886115 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:18.887561 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:18.891837 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:18.894588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:18.970338 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f831-b4ec-4e0a-bcd0-5b596b0b5e41 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:18.975361 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:18.976861 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:18.977165 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:18.977443 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] PATH_INFO: `/v3/projects/cfd703e9dd3e460d992ef2daab104619` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:18.978781 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd703e9dd3e460d992ef2daab104619)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:18.980732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:18.981586 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42a65-6765-495e-bcb7-7fed6c5a830c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:19.028112 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd703e9dd3e460d992ef2daab104619', 'request_id': 'req-23f5a173-5cd2-41c6-95e6-356e6b58a132'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.036201 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd703e9dd3e460d992ef2daab104619', 'request_id': 'req-23f5a173-5cd2-41c6-95e6-356e6b58a132'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.044276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd703e9dd3e460d992ef2daab104619', 'request_id': 'req-23f5a173-5cd2-41c6-95e6-356e6b58a132'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.047772 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be883e9492f14daa856a2a9eba500bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:19.048431 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:19.048714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:19.048993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:19.050818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:19.055491 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] The token cache is being invalidate because project cfd703e9dd3e460d992ef2daab104619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:19.055950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.056585 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.058178 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1388/2747] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:18 2022] DELETE /identity/v3/projects/cfd703e9dd3e460d992ef2daab104619 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:19.062110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:19.063442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:19.112775 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:19.114526 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:19.124883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1360/2748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:19.134317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5a173-5cd2-41c6-95e6-356e6b58a132 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:19.147210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:19.148255 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:19.148537 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:19.148815 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] PATH_INFO: `/v3/users/63e35f4f1d724c31ac8c5e380263af26` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:19.150373 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e35f4f1d724c31ac8c5e380263af26)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:19.152387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:19.202947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e35f4f1d724c31ac8c5e380263af26'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.215411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e35f4f1d724c31ac8c5e380263af26'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.223821 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e35f4f1d724c31ac8c5e380263af26'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.224600 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e35f4f1d724c31ac8c5e380263af26'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.232335 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e35f4f1d724c31ac8c5e380263af26'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.238990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1389/2749] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:19 2022] DELETE /identity/v3/users/63e35f4f1d724c31ac8c5e380263af26 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:19:19.439826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:19.450856 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b479-6707-47eb-8223-f4c1a456b930 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:19.520520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:19.521475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:19.521867 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:19.522235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] PATH_INFO: `/v3/projects/601b87adc4a2466a841a8b1b58a898d5` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:19.524228 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601b87adc4a2466a841a8b1b58a898d5)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:19.526502 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:19.574641 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601b87adc4a2466a841a8b1b58a898d5', 'request_id': 'req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.584169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601b87adc4a2466a841a8b1b58a898d5', 'request_id': 'req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.592266 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601b87adc4a2466a841a8b1b58a898d5', 'request_id': 'req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.603427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] The token cache is being invalidate because project 601b87adc4a2466a841a8b1b58a898d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:19.603712 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.604380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:19.606286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1361/2750] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:19 2022] DELETE /identity/v3/projects/601b87adc4a2466a841a8b1b58a898d5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:20.574328 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:20.575731 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:20.636652 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfc6f3-8a9a-4a03-a1f5-5839bc251026 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:20.691213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:20.691860 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:20.692139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:20.692412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:20.694214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:20.763569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:20.764933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:20.776539 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1390/2751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:27.616390 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:27.618565 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:27.631497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0d339-13f0-4fe4-8dc1-68bd628f7f43 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:27.635411 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:27.636079 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:27.636359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:27.636631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:27.640718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:27.655910 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:27.657369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:27.670334 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1362/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:37.046310 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:37.048013 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:37.106424 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533f175-15e3-447c-8729-b8fc5a98e489 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:37.110277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:37.110918 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:37.111192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:37.111458 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:37.113359 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:37.177268 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:37.178912 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:37.189721 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1391/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:40.571072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:40.572560 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:40.586849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d539cb-1295-450b-bc2e-40405b752416 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:40.594000 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:40.594875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:40.595162 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:40.595441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] PATH_INFO: `/v3/users/5a07a92c35e84b0084c2a96263897e92` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:40.596675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a07a92c35e84b0084c2a96263897e92)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:40.598654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:40.648958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a07a92c35e84b0084c2a96263897e92'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:40.660646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a07a92c35e84b0084c2a96263897e92'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:40.661375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a07a92c35e84b0084c2a96263897e92'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:40.668769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a07a92c35e84b0084c2a96263897e92'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:40.675542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-78e278b1-ecdd-4da4-9f09-c737a2dea9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a07a92c35e84b0084c2a96263897e92'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:40.681697 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1363/2754] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:40 2022] DELETE /identity/v3/users/5a07a92c35e84b0084c2a96263897e92 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:19:40.873785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:40.885274 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9552d8-eab8-48bc-9fcd-2006b315cf3d service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:40.949526 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:40.950411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:40.950691 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:40.950960 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] PATH_INFO: `/v3/projects/9bc2618a240d4702b6c7660829fabbcd` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:40.952135 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc2618a240d4702b6c7660829fabbcd)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:40.954061 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:40.999193 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc2618a240d4702b6c7660829fabbcd', 'request_id': 'req-dc0314ac-5a4c-4569-a293-62c261e367c4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:41.007534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc2618a240d4702b6c7660829fabbcd', 'request_id': 'req-dc0314ac-5a4c-4569-a293-62c261e367c4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:41.014042 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc2618a240d4702b6c7660829fabbcd', 'request_id': 'req-dc0314ac-5a4c-4569-a293-62c261e367c4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:41.025743 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] The token cache is being invalidate because project 9bc2618a240d4702b6c7660829fabbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:41.026032 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:41.026881 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc0314ac-5a4c-4569-a293-62c261e367c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:41.028816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1392/2755] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:40 2022] DELETE /identity/v3/projects/9bc2618a240d4702b6c7660829fabbcd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:41.034148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.034434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.034738 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.052264 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:41.053472 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:41.117487 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1364/2756] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:19:41.126749 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.127035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.127334 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.148418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:41.149711 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:41.158540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1393/2757] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:41.163004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.173309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089b27-4da1-476f-b97c-738029a07ed1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.179440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.180098 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.180381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.180658 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.181401 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:19:41.181754 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.183374 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.196562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1365/2758] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:19:41.200930 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.210969 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0913-e495-4a81-9ee2-3048b2d74c4a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.216053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.216761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.217044 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.217340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.218079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.220010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.249317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1394/2759] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:41.253539 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.264866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f5a2-8bb2-43ce-a402-187bee8957f9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.324557 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.325237 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.325517 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.325820 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.326512 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.328423 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.348957 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1366/2760] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:19:41.353183 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.364079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c648f-5892-4ce3-9fa8-ae9d4f8d9945 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.369395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.370096 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.370379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.370653 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.371379 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.372979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.384549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1395/2761] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:41.388943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.399792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25569cc-540c-4a88-9732-6cd3a53f3b8c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.404781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11d649-ea70-44c9-923f-5fcc84b64e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.405454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11d649-ea70-44c9-923f-5fcc84b64e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.405769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11d649-ea70-44c9-923f-5fcc84b64e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.406046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11d649-ea70-44c9-923f-5fcc84b64e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.406781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11d649-ea70-44c9-923f-5fcc84b64e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.408377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11d649-ea70-44c9-923f-5fcc84b64e45 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.419700 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1367/2762] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:41.424024 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.434943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe84f-1f83-44c1-8e43-dd56a7f739df admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.440439 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.441362 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.441670 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.441945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] PATH_INFO: `/v3/projects/c9240979b272490aa51fd9c580c60f56/users/674f18d816df4cd1814f6236585b9fa0/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.458321 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9240979b272490aa51fd9c580c60f56, user_id=674f18d816df4cd1814f6236585b9fa0, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.461707 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.476682 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1396/2763] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:41 2022] PUT /identity/v3/projects/c9240979b272490aa51fd9c580c60f56/users/674f18d816df4cd1814f6236585b9fa0/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:41.487375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe884-c24d-4553-a793-b02dba257087 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.487665 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe884-c24d-4553-a793-b02dba257087 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.487944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe884-c24d-4553-a793-b02dba257087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.516213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-894fe884-c24d-4553-a793-b02dba257087 None None] MFA Rules not processed for user `674f18d816df4cd1814f6236585b9fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:41.517354 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-894fe884-c24d-4553-a793-b02dba257087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:41.592532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1368/2764] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:41.597608 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.663908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da298eb-35d8-4201-acdd-938817a0ad2e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.668788 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.669475 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.669786 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.670059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.670758 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.672710 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.708812 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1397/2765] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:41.714035 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe884-c24d-4553-a793-b02dba257087 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.731046 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe884-c24d-4553-a793-b02dba257087 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.800631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.801321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.801633 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.801913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.802611 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.804554 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.828823 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1369/2766] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:19:41 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:41.830090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.841227 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee2dc-1a89-41ed-8cfa-99917a8792de admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.846017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.846701 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.846975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.847242 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.847993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.849627 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.860942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1398/2767] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:19:41.865337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.876937 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2b48-9548-4348-82f1-90b5d06c987c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.881698 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.882767 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.883052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.883330 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] PATH_INFO: `/v3/projects/c477da3ac3ed46e4adb22ad9e599ed89/users/15ccb57ec1294532843c83efb992a838/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.900749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c477da3ac3ed46e4adb22ad9e599ed89, user_id=15ccb57ec1294532843c83efb992a838, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.903603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:41.918171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1370/2768] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:41 2022] PUT /identity/v3/projects/c477da3ac3ed46e4adb22ad9e599ed89/users/15ccb57ec1294532843c83efb992a838/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:41.922421 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:41.933059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c72aa8-4ca0-4570-b25e-b9a04d95bd26 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:41.991179 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65d156-cca1-44ad-9202-17a0157f9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:41.991975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d156-cca1-44ad-9202-17a0157f9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:41.992260 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d156-cca1-44ad-9202-17a0157f9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:41.992540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d156-cca1-44ad-9202-17a0157f9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:41.993269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65d156-cca1-44ad-9202-17a0157f9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:41.995023 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65d156-cca1-44ad-9202-17a0157f9b46 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:42.005151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1399/2769] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:42.009410 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:42.019859 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3d7a7-3d24-45f7-92da-5bde16a1c0e5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:42.025108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:42.026325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:42.026603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:42.026875 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] PATH_INFO: `/v3/projects/c477da3ac3ed46e4adb22ad9e599ed89/users/15ccb57ec1294532843c83efb992a838/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:42.028929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c477da3ac3ed46e4adb22ad9e599ed89, user_id=15ccb57ec1294532843c83efb992a838, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:42.031761 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:42.043973 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1371/2770] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:42 2022] PUT /identity/v3/projects/c477da3ac3ed46e4adb22ad9e599ed89/users/15ccb57ec1294532843c83efb992a838/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:42.054785 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:42.055073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:42.055355 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:42.084477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] MFA Rules not processed for user `15ccb57ec1294532843c83efb992a838`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:42.086277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:42.166655 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1400/2771] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:42.181251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:42.183226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:42.242915 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a486785-05ad-49c7-9442-c5d6aef9d3bd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:42.246958 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:42.247631 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:42.248018 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:42.248572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:42.259342 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:42.260837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:42.272066 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1372/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:42.368383 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:42.378408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4511a3-3e29-4abc-8674-fe1e86dab230 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:42.383277 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215089-97dc-4e81-aa26-158b7af5193e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:42.383945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215089-97dc-4e81-aa26-158b7af5193e service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:42.384229 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215089-97dc-4e81-aa26-158b7af5193e service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:42.384501 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215089-97dc-4e81-aa26-158b7af5193e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:42.451588 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215089-97dc-4e81-aa26-158b7af5193e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:42.453387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215089-97dc-4e81-aa26-158b7af5193e service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:42.464224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1401/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:51.530890 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:51.591794 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c2e8c-dac6-4b91-9794-bb2f4d41aaf5 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:51.596465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:51.597332 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:51.597762 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:51.598043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] PATH_INFO: `/v3/users/674f18d816df4cd1814f6236585b9fa0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:51.599241 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=674f18d816df4cd1814f6236585b9fa0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:51.601828 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:51.648803 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674f18d816df4cd1814f6236585b9fa0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:51.660511 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674f18d816df4cd1814f6236585b9fa0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:51.661205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674f18d816df4cd1814f6236585b9fa0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:51.668353 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674f18d816df4cd1814f6236585b9fa0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:51.675986 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674f18d816df4cd1814f6236585b9fa0'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:51.682187 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1373/2774] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:51 2022] DELETE /identity/v3/users/674f18d816df4cd1814f6236585b9fa0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:51.686809 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:51.687279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:51.687393 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:51.716131 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:51.717349 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:51.775775 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1402/2775] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:19:51.785497 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:51.787357 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:51.847351 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f1bd-e931-4fc3-bf90-4ddc70879fde admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:51.852023 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:51.852705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:51.852990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:51.853269 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:51.863595 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:51.864392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:51.882624 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1374/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:19:52.152048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:52.153647 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:52.172951 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c03946-21ae-43f8-b9b8-98da6d058b0e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:52.178052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:52.179664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:52.180026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:52.180301 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] PATH_INFO: `/v3/projects/c9240979b272490aa51fd9c580c60f56` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:52.182223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9240979b272490aa51fd9c580c60f56)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:52.184329 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:52.247064 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9240979b272490aa51fd9c580c60f56', 'request_id': 'req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.256744 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9240979b272490aa51fd9c580c60f56', 'request_id': 'req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.265533 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9240979b272490aa51fd9c580c60f56', 'request_id': 'req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.281696 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] The token cache is being invalidate because project c9240979b272490aa51fd9c580c60f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:52.282192 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.283208 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.285740 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1403/2777] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:52 2022] DELETE /identity/v3/projects/c9240979b272490aa51fd9c580c60f56 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:52.290160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:52.306870 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec5d1-1502-420b-b280-010951291885 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:52.373848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:52.374954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:52.375366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:52.375838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] PATH_INFO: `/v3/users/15ccb57ec1294532843c83efb992a838` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:52.377386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ccb57ec1294532843c83efb992a838)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:52.379939 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:52.428524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ccb57ec1294532843c83efb992a838'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.445461 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ccb57ec1294532843c83efb992a838'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.446229 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ccb57ec1294532843c83efb992a838'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.453083 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ccb57ec1294532843c83efb992a838'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.462125 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36369886-5f60-4543-ad6c-9e4c873ffc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ccb57ec1294532843c83efb992a838'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.468559 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1375/2778] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:52 2022] DELETE /identity/v3/users/15ccb57ec1294532843c83efb992a838 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:19:52.748685 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:52.750941 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:52.773506 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbfcc9-7f70-47c9-a7f2-1fe7a1ca3332 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:52.860792 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:52.862312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:52.862808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:52.863303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] PATH_INFO: `/v3/projects/c477da3ac3ed46e4adb22ad9e599ed89` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:52.865293 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c477da3ac3ed46e4adb22ad9e599ed89)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:52.869381 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:52.932313 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c477da3ac3ed46e4adb22ad9e599ed89', 'request_id': 'req-83b448c0-12d3-4f1d-ae87-7184d500e04d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.940122 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c477da3ac3ed46e4adb22ad9e599ed89', 'request_id': 'req-83b448c0-12d3-4f1d-ae87-7184d500e04d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.946555 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c477da3ac3ed46e4adb22ad9e599ed89', 'request_id': 'req-83b448c0-12d3-4f1d-ae87-7184d500e04d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.956983 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] The token cache is being invalidate because project c477da3ac3ed46e4adb22ad9e599ed89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:52.957266 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.957937 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-83b448c0-12d3-4f1d-ae87-7184d500e04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:52.959499 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1404/2779] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:52 2022] DELETE /identity/v3/projects/c477da3ac3ed46e4adb22ad9e599ed89 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:19:52.965588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:52.966068 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:52.966201 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:52.984343 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:52.985916 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:53.045960 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1376/2780] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:19:53.056356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.056637 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.056916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.075176 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:53.076302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:53.084336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1405/2781] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:19:53.088707 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.098400 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631873-66ac-4ef5-b5fe-d9132937360c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.103490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.104160 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.104441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.104714 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.105440 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:19:53.105787 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.107381 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.120727 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1377/2782] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:19:53.124540 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.134219 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455563f-1043-4673-826d-a505a3b9f578 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.138847 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.139500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.139782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.140147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.140768 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.142782 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.171654 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1406/2783] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:53.175602 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.185614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d251a5-0d41-4bea-ad03-688965a726f6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.240572 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.241407 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.241733 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.242012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.242716 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.244651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.265310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1378/2784] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:19:53.269581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.280516 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6f0e-b907-43e4-94d2-1f801a5b0229 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.285119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.285807 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.286085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.286356 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.287070 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.289213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.300450 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1407/2785] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:53.305746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.315975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cca58-4899-48ed-bf3f-55506f45e923 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.320562 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198082e4-5624-4cbd-95e5-dd882270906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.321216 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198082e4-5624-4cbd-95e5-dd882270906b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.321495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198082e4-5624-4cbd-95e5-dd882270906b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.321801 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198082e4-5624-4cbd-95e5-dd882270906b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.322516 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198082e4-5624-4cbd-95e5-dd882270906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.324102 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198082e4-5624-4cbd-95e5-dd882270906b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.334063 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1379/2786] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 14:19:53.338641 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.348875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44def984-9737-4a88-9cca-0c82d00a7342 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.355387 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.356479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.356859 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.357243 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] PATH_INFO: `/v3/projects/7b640791194e4271bf1f620564714069/users/1889287634944360aeefe6ffc6f4139f/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.372197 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b640791194e4271bf1f620564714069, user_id=1889287634944360aeefe6ffc6f4139f, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.374878 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.387344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1408/2787] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:53 2022] PUT /identity/v3/projects/7b640791194e4271bf1f620564714069/users/1889287634944360aeefe6ffc6f4139f/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:53.398210 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.398499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.398776 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.425605 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] MFA Rules not processed for user `1889287634944360aeefe6ffc6f4139f`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:53.426832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:53.488222 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1380/2788] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:53.492906 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.556204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae074b-a160-4991-8ebf-e92ac14f86ca admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.560946 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.561636 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.561919 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.562194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.562896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.564814 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.593990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1409/2789] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:53.598104 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.608630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854245e-7ff1-4637-8587-5112c547a545 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.664625 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.665305 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.665615 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.665886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.666578 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.668532 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.688446 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1381/2790] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:53.692684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.703734 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5dbaf-d22c-47b3-9b62-501e2f460ff2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.708460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.709148 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.709428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.709729 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.711053 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.712644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.723400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1410/2791] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:53.727755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.737846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d2d1-b660-4091-b440-6ab1e4c64c26 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.742747 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.743974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.744252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.744524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] PATH_INFO: `/v3/projects/35ac9b9105e04ad4b8752f86ce4d05ac/users/c0dcc56add4a4c96950bda8809e13ef2/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.759764 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ac9b9105e04ad4b8752f86ce4d05ac, user_id=c0dcc56add4a4c96950bda8809e13ef2, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.763845 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.778307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1382/2792] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:53 2022] PUT /identity/v3/projects/35ac9b9105e04ad4b8752f86ce4d05ac/users/c0dcc56add4a4c96950bda8809e13ef2/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:53.782317 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.792413 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ff719-c67e-4416-a193-22ea7d3d1e7b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.855773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88b9c-3271-428b-bbd0-5dbc879b866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.856337 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88b9c-3271-428b-bbd0-5dbc879b866a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.856613 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88b9c-3271-428b-bbd0-5dbc879b866a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.856884 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88b9c-3271-428b-bbd0-5dbc879b866a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.857629 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b88b9c-3271-428b-bbd0-5dbc879b866a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.859237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b88b9c-3271-428b-bbd0-5dbc879b866a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.869800 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1411/2793] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:53.874176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:53.884914 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b100a2-735e-45e8-a63b-287f9a859501 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:53.889718 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:53.890603 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.890884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.891158 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] PATH_INFO: `/v3/projects/35ac9b9105e04ad4b8752f86ce4d05ac/users/c0dcc56add4a4c96950bda8809e13ef2/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.893149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ac9b9105e04ad4b8752f86ce4d05ac, user_id=c0dcc56add4a4c96950bda8809e13ef2, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:53.895818 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:53.911495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1383/2794] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:53 2022] PUT /identity/v3/projects/35ac9b9105e04ad4b8752f86ce4d05ac/users/c0dcc56add4a4c96950bda8809e13ef2/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:53.923461 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:53.923780 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:53.924063 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:53.952835 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] MFA Rules not processed for user `c0dcc56add4a4c96950bda8809e13ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:53.954141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:54.064224 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1412/2795] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:54.077950 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:54.079084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:54.139148 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5152a-b14a-4d15-aecd-169631573999 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:54.142849 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:54.143495 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:54.143774 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:54.144053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:54.153970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:54.155425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:54.165283 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1384/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:19:54.216560 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:54.217996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:54.231021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fb876-3f16-4640-bbff-0c4e5c10e18a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:54.234791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357b51a-ad17-499f-bd62-e5a19e312d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:54.235470 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b51a-ad17-499f-bd62-e5a19e312d2e service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:54.235751 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b51a-ad17-499f-bd62-e5a19e312d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:54.236015 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b51a-ad17-499f-bd62-e5a19e312d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:54.315157 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357b51a-ad17-499f-bd62-e5a19e312d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:54.317922 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357b51a-ad17-499f-bd62-e5a19e312d2e service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:54.330253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1413/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:57.720832 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:57.831421 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ea7e-e189-4b4b-912c-020de7ecaabf service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:57.836371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:57.837245 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:57.837519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:57.837819 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] PATH_INFO: `/v3/users/1889287634944360aeefe6ffc6f4139f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:57.839043 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1889287634944360aeefe6ffc6f4139f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:57.841042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:57.891933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1889287634944360aeefe6ffc6f4139f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:57.904278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1889287634944360aeefe6ffc6f4139f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:57.905007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1889287634944360aeefe6ffc6f4139f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:57.912149 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1889287634944360aeefe6ffc6f4139f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:57.919323 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1889287634944360aeefe6ffc6f4139f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:57.925385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1385/2798] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:57 2022] DELETE /identity/v3/users/1889287634944360aeefe6ffc6f4139f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:57.930567 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:57.931105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:57.931105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:57.979963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:57.981173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:58.046365 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1414/2799] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:58.056996 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:58.058483 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:58.156388 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8ca3-06d8-469d-8ab0-881a00535cd0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:58.159946 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:58.160596 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:58.160873 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:58.161146 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:58.171635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:58.173233 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:58.183814 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1386/2800] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:19:58.459441 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:58.461221 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:58.478132 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e708365-59aa-4ea3-b30a-8e75f20d27c5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:58.483191 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:58.484085 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:58.484479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:58.484623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] PATH_INFO: `/v3/projects/7b640791194e4271bf1f620564714069` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:58.485963 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b640791194e4271bf1f620564714069)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:58.487901 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:58.540231 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b640791194e4271bf1f620564714069', 'request_id': 'req-51d05822-15de-4c19-b439-4b02da2bafa6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.551402 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b640791194e4271bf1f620564714069', 'request_id': 'req-51d05822-15de-4c19-b439-4b02da2bafa6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.560352 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b640791194e4271bf1f620564714069', 'request_id': 'req-51d05822-15de-4c19-b439-4b02da2bafa6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.571808 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] The token cache is being invalidate because project 7b640791194e4271bf1f620564714069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:58.572098 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.572776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.574404 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1415/2801] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:58 2022] DELETE /identity/v3/projects/7b640791194e4271bf1f620564714069 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:58.579163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:58.595430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd432e-2baf-496b-87b9-b3a8a528bb4c service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:58.662282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:58.662282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:58.662660 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:58.662755 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] PATH_INFO: `/v3/users/c0dcc56add4a4c96950bda8809e13ef2` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:58.664663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0dcc56add4a4c96950bda8809e13ef2)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:58.667052 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:58.715080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0dcc56add4a4c96950bda8809e13ef2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.727107 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0dcc56add4a4c96950bda8809e13ef2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.727826 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0dcc56add4a4c96950bda8809e13ef2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.734582 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0dcc56add4a4c96950bda8809e13ef2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.742156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c3656f39-386a-4130-94d7-99e9977ec21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0dcc56add4a4c96950bda8809e13ef2'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:58.748943 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1387/2802] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:19:58 2022] DELETE /identity/v3/users/c0dcc56add4a4c96950bda8809e13ef2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:59.080382 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.081993 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:59.096828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d05822-15de-4c19-b439-4b02da2bafa6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.170168 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.171289 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.171620 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.171950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] PATH_INFO: `/v3/projects/35ac9b9105e04ad4b8752f86ce4d05ac` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.173480 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ac9b9105e04ad4b8752f86ce4d05ac)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.175776 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.229173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ac9b9105e04ad4b8752f86ce4d05ac', 'request_id': 'req-f86b92d5-cd7d-4601-90c8-919ef0451e93'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:59.243049 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ac9b9105e04ad4b8752f86ce4d05ac', 'request_id': 'req-f86b92d5-cd7d-4601-90c8-919ef0451e93'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:59.256067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ac9b9105e04ad4b8752f86ce4d05ac', 'request_id': 'req-f86b92d5-cd7d-4601-90c8-919ef0451e93'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:59.276831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] The token cache is being invalidate because project 35ac9b9105e04ad4b8752f86ce4d05ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:19:59.277457 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:59.278524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f86b92d5-cd7d-4601-90c8-919ef0451e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:19:59.281366 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1416/2803] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:19:59 2022] DELETE /identity/v3/projects/35ac9b9105e04ad4b8752f86ce4d05ac => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:19:59.296005 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.296490 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.296991 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.349642 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:59.351037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:59.414968 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1388/2804] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:19:59.423182 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.423471 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.423748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.443972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:59.445799 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:59.453747 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1417/2805] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:59.458285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.469108 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144e9b5-bd63-49b9-9ae8-0fe7f5e49e47 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.474420 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.475096 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.475375 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.476285 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.477147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:19:59.477459 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.479169 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.493645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1389/2806] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:19:59.496279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.505965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c680-091f-44cb-b2f2-bfde6fa5054f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.511320 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.511986 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.512267 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.512543 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.513259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.515299 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.544187 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1418/2807] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:59.548749 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.559371 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca91a4-5225-496b-bbe3-053f6f495a36 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.622258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.622972 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.623265 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.623663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.624386 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.626380 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.648263 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1390/2808] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:19:59.655213 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.673265 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9ee95-7e4f-4c28-bacf-8aee9de90d2c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.681312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.682527 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.683048 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.683549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.684971 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.688173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.708748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1419/2809] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:59.713385 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.723405 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf72109-0647-4d3b-af9d-af40d3cc9cbd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.728073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bb9d4-bc6c-4e02-8c18-d340e20c373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.728730 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb9d4-bc6c-4e02-8c18-d340e20c373b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.729016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb9d4-bc6c-4e02-8c18-d340e20c373b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.729296 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb9d4-bc6c-4e02-8c18-d340e20c373b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.730051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bb9d4-bc6c-4e02-8c18-d340e20c373b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.731645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bb9d4-bc6c-4e02-8c18-d340e20c373b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.741543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1391/2810] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:19:59.745802 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.755648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfd078-ab20-4c9a-aa15-45e6e0dec3a3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.760761 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.761771 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.762097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.762460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] PATH_INFO: `/v3/projects/4ba3e780041949bd87c2f25ecde6613b/users/44b7141f9efd427183f86e1e9c213918/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.780302 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba3e780041949bd87c2f25ecde6613b, user_id=44b7141f9efd427183f86e1e9c213918, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.783262 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.798136 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1420/2811] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:19:59 2022] PUT /identity/v3/projects/4ba3e780041949bd87c2f25ecde6613b/users/44b7141f9efd427183f86e1e9c213918/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:19:59.808427 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.808721 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.809002 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.834848 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] MFA Rules not processed for user `44b7141f9efd427183f86e1e9c213918`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:19:59.836715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:19:59.898243 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1392/2812] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:19:59.903141 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:19:59.962562 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c83db-1661-4604-8935-1ba71bc80c85 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:19:59.967173 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:19:59.967816 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:19:59.968097 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:19:59.968371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:19:59.969059 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:19:59.970980 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:19:59.995563 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1421/2813] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:19:59.999654 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.011235 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6099fd2-8d2c-4dbe-89ca-bafcad2545ea None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.065974 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.066656 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.066981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.067308 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.067970 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.070192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.093297 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1393/2814] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:19:59 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:20:00.101823 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.113965 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec591-12cb-4855-8694-e7569516bc92 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.119482 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.120155 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.120435 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.120716 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.121446 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.123090 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.135466 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1422/2815] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:00.139686 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.149944 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd65a0-ad2e-48e4-b63e-2e4837dc5eeb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.155075 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.156004 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.156288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.156569 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] PATH_INFO: `/v3/projects/b035a355a1d344e8989ba5781f4b7007/users/3798f4b1e3aa444f88aa54c78245591a/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.178120 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b035a355a1d344e8989ba5781f4b7007, user_id=3798f4b1e3aa444f88aa54c78245591a, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.183524 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.200542 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1394/2816] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:00 2022] PUT /identity/v3/projects/b035a355a1d344e8989ba5781f4b7007/users/3798f4b1e3aa444f88aa54c78245591a/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:00.204557 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.215027 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8692d-d589-4399-97a4-3db6cc1ffada admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.283732 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86777377-62aa-4f57-95dd-177612a10675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.284723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86777377-62aa-4f57-95dd-177612a10675 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.285202 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86777377-62aa-4f57-95dd-177612a10675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.285712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86777377-62aa-4f57-95dd-177612a10675 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.286984 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86777377-62aa-4f57-95dd-177612a10675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.290444 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86777377-62aa-4f57-95dd-177612a10675 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.308737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1423/2817] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:00.314348 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.324763 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac00d0-b048-4030-8881-964c3b036a58 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.329443 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.330393 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.330675 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.330952 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] PATH_INFO: `/v3/projects/b035a355a1d344e8989ba5781f4b7007/users/3798f4b1e3aa444f88aa54c78245591a/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.332942 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b035a355a1d344e8989ba5781f4b7007, user_id=3798f4b1e3aa444f88aa54c78245591a, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.335608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.345954 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1395/2818] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:00 2022] PUT /identity/v3/projects/b035a355a1d344e8989ba5781f4b7007/users/3798f4b1e3aa444f88aa54c78245591a/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:20:00.358644 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.358976 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.359295 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.387371 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] MFA Rules not processed for user `3798f4b1e3aa444f88aa54c78245591a`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:00.388683 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:00.462990 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1424/2819] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:20:00.474136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.476408 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:00.537053 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858e83-e5e5-4667-8a9d-5ce40718c009 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.541136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.541805 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.542089 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.542366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.551655 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.553085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.563666 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1396/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:00.665026 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:00.674733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20986-9b52-411e-aefd-bdcb3f9d5565 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:00.678384 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ef9f5-7396-4e71-bff3-f7044aef84f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:00.679079 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ef9f5-7396-4e71-bff3-f7044aef84f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:00.679515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ef9f5-7396-4e71-bff3-f7044aef84f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:00.679791 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ef9f5-7396-4e71-bff3-f7044aef84f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:00.736133 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ef9f5-7396-4e71-bff3-f7044aef84f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:00.737610 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ef9f5-7396-4e71-bff3-f7044aef84f4 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:00.746612 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1425/2821] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:03.306310 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:03.377016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a97e-22d3-48f6-bf99-919bd0fffaf5 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:03.383112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:03.383981 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:03.384260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:03.384534 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] PATH_INFO: `/v3/users/44b7141f9efd427183f86e1e9c213918` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:03.385785 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b7141f9efd427183f86e1e9c213918)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:03.387715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:03.432499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b7141f9efd427183f86e1e9c213918'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:03.443919 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b7141f9efd427183f86e1e9c213918'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:03.445227 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b7141f9efd427183f86e1e9c213918'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:03.454139 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b7141f9efd427183f86e1e9c213918'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:03.462647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b7141f9efd427183f86e1e9c213918'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:03.469657 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1397/2822] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:20:03 2022] DELETE /identity/v3/users/44b7141f9efd427183f86e1e9c213918 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:03.474728 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:03.475250 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:03.475389 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:03.492572 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:03.493822 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:03.555864 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1426/2823] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:03.565838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:03.567247 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:03.622838 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bb854-eb57-44d3-9286-20a9f93c88a4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:03.626588 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:03.627286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:03.627519 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:03.627798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:03.637520 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:03.639016 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:03.648454 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1398/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:03.914418 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:03.916041 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:03.932911 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5605-a4d2-4fee-8579-6af6e79d3efb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:03.937876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:03.938663 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:03.939010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:03.939226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] PATH_INFO: `/v3/projects/4ba3e780041949bd87c2f25ecde6613b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:03.940680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba3e780041949bd87c2f25ecde6613b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:03.942617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:04.004827 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba3e780041949bd87c2f25ecde6613b', 'request_id': 'req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.012828 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba3e780041949bd87c2f25ecde6613b', 'request_id': 'req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.019515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba3e780041949bd87c2f25ecde6613b', 'request_id': 'req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.031147 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] The token cache is being invalidate because project 4ba3e780041949bd87c2f25ecde6613b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:20:04.031434 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.032105 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.033697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1427/2825] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:20:03 2022] DELETE /identity/v3/projects/4ba3e780041949bd87c2f25ecde6613b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:20:04.037769 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:04.047836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e72d3-d742-49c4-a285-7721a688f354 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:04.114711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:04.115630 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.116073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.116959 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] PATH_INFO: `/v3/users/3798f4b1e3aa444f88aa54c78245591a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.118284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3798f4b1e3aa444f88aa54c78245591a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:04.120322 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:04.165282 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3798f4b1e3aa444f88aa54c78245591a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.179419 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3798f4b1e3aa444f88aa54c78245591a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.180147 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3798f4b1e3aa444f88aa54c78245591a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.186866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3798f4b1e3aa444f88aa54c78245591a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.194377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-186fe3a5-36b1-47bc-a988-55cd96d03b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3798f4b1e3aa444f88aa54c78245591a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.200364 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1399/2826] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:20:04 2022] DELETE /identity/v3/users/3798f4b1e3aa444f88aa54c78245591a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:04.482380 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:04.485028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:04.507880 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdfd65-69a9-4c00-ad7a-b31439f9a3da admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:04.576773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:04.577844 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.579167 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.579455 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] PATH_INFO: `/v3/projects/b035a355a1d344e8989ba5781f4b7007` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.580690 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b035a355a1d344e8989ba5781f4b7007)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:04.582664 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:04.634795 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b035a355a1d344e8989ba5781f4b7007', 'request_id': 'req-39b270b1-ae94-4729-ba1a-8300074934d0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.642510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b035a355a1d344e8989ba5781f4b7007', 'request_id': 'req-39b270b1-ae94-4729-ba1a-8300074934d0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.649581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b035a355a1d344e8989ba5781f4b7007', 'request_id': 'req-39b270b1-ae94-4729-ba1a-8300074934d0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.661395 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] The token cache is being invalidate because project b035a355a1d344e8989ba5781f4b7007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:20:04.661748 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.662364 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-39b270b1-ae94-4729-ba1a-8300074934d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:04.664595 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1428/2827] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:20:04 2022] DELETE /identity/v3/projects/b035a355a1d344e8989ba5781f4b7007 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:04.669894 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.670392 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.670513 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.688885 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:04.690151 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:04.751011 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1400/2828] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:04.759218 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.759589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.759945 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.780153 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:04.781478 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:04.789979 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1429/2829] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:04.794325 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:04.807178 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921a0a3-3ab3-4c46-a472-190a22b794de None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:04.814355 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:04.815177 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.815568 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.815836 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.816634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:20:04.816935 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:04.818719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:04.833208 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1401/2830] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:20:04.838486 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:04.849784 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b03157-97e7-48da-9e84-f74dc37aa338 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:04.855232 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:04.855908 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.856199 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.856477 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.857204 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:04.859253 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:04.890839 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1430/2831] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:20:04 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:04.896758 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:04.908224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ed914-59cd-4f78-9277-5bff457b05af admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:04.969674 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:04.970363 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:04.970651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:04.970912 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:04.971902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:04.973883 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:04.997500 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1402/2832] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:20:04 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:05.001623 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.012752 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826256d-6c4a-4f54-95da-353f754a95b5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.017528 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.018326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.018676 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.019028 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.019831 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.021515 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.034228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1431/2833] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:05.038453 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.049637 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a123-26dd-48c6-8786-a35e83572dcb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.056530 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c1a58-df35-4ac9-87d0-05332dc808e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.057337 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c1a58-df35-4ac9-87d0-05332dc808e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.057646 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c1a58-df35-4ac9-87d0-05332dc808e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.057921 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c1a58-df35-4ac9-87d0-05332dc808e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.058736 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c1a58-df35-4ac9-87d0-05332dc808e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.060452 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c1a58-df35-4ac9-87d0-05332dc808e3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.072975 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1403/2834] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:05.078214 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.089237 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad98fe-f096-4862-96d0-662b1bdba8b1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.093994 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.094942 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.095226 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.095500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] PATH_INFO: `/v3/projects/10dd11b018aa441faa84b3bf087ce69b/users/4c89e687a59b457c89388929d3a4a56b/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.115684 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10dd11b018aa441faa84b3bf087ce69b, user_id=4c89e687a59b457c89388929d3a4a56b, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.119363 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.135975 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1432/2835] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:05 2022] PUT /identity/v3/projects/10dd11b018aa441faa84b3bf087ce69b/users/4c89e687a59b457c89388929d3a4a56b/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:05.147213 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.147587 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.147902 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.176990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] MFA Rules not processed for user `4c89e687a59b457c89388929d3a4a56b`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:05.179556 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:05.252720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1404/2836] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:05.257950 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.325194 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf5e9-b68e-4176-806d-8ac8ffece97f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.330195 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.330867 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.331151 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.331427 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.332127 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.334203 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.361207 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1433/2837] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:20:05 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:05.365473 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.376598 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaedd64-5099-43c4-b9b5-26422dbb030d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.442051 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.442728 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.443012 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.443302 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.443990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.446600 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.466286 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1405/2838] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:20:05 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:05.470485 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.481303 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf942c3-46c4-4d2b-addb-2dc85b81c2fa admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.486010 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.486671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.486953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.487230 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.487952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.489549 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.500925 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1434/2839] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:05.505217 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.515488 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874012-7788-4dc5-aa74-cd4d451c4d52 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.520087 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.520978 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.521260 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.521535 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] PATH_INFO: `/v3/projects/e785f7432b98459d93f750fea7c3674f/users/cf3938e0200f4a9abe1937e840df959f/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.541105 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e785f7432b98459d93f750fea7c3674f, user_id=cf3938e0200f4a9abe1937e840df959f, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.544299 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.561234 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1406/2840] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:05 2022] PUT /identity/v3/projects/e785f7432b98459d93f750fea7c3674f/users/cf3938e0200f4a9abe1937e840df959f/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:05.565378 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.575842 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78738-1b3a-4ed7-aac1-a0d06dd433ff admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.634671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54b97-0306-4991-b17c-c359c47c8f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.635336 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54b97-0306-4991-b17c-c359c47c8f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.635617 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54b97-0306-4991-b17c-c359c47c8f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.635888 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54b97-0306-4991-b17c-c359c47c8f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.636597 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54b97-0306-4991-b17c-c359c47c8f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.638215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54b97-0306-4991-b17c-c359c47c8f45 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.647733 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1435/2841] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:05.652451 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.662509 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6c06-a097-42d2-84c0-1893fb2394ed admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.667909 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.668810 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.669095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.669373 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] PATH_INFO: `/v3/projects/e785f7432b98459d93f750fea7c3674f/users/cf3938e0200f4a9abe1937e840df959f/roles/14e44e8972ac470caeba21b91a163d08` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.671434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e785f7432b98459d93f750fea7c3674f, user_id=cf3938e0200f4a9abe1937e840df959f, role_id=14e44e8972ac470caeba21b91a163d08)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.674136 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.685224 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1407/2842] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:05 2022] PUT /identity/v3/projects/e785f7432b98459d93f750fea7c3674f/users/cf3938e0200f4a9abe1937e840df959f/roles/14e44e8972ac470caeba21b91a163d08 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:05.746934 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938784f5-7356-4940-a882-b02d97032435 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.747228 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938784f5-7356-4940-a882-b02d97032435 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.747505 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938784f5-7356-4940-a882-b02d97032435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.773904 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-938784f5-7356-4940-a882-b02d97032435 None None] MFA Rules not processed for user `cf3938e0200f4a9abe1937e840df959f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:05.775035 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-938784f5-7356-4940-a882-b02d97032435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:05.849442 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1436/2843] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:05.861478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:05.863278 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:05.923284 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7355918-f3c5-46b4-b46f-edcbf9ef60ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:05.926891 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:05.927555 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:05.927834 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:05.928103 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:05.981673 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:05.983112 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:05.992029 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1408/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:10.238524 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938784f5-7356-4940-a882-b02d97032435 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:10.239953 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-938784f5-7356-4940-a882-b02d97032435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:10.251843 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938784f5-7356-4940-a882-b02d97032435 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:10.255353 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aeb71-682a-4946-9f68-834db94b4595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e91a0ab4e4c4f4d96f357e7770a011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:10.255995 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aeb71-682a-4946-9f68-834db94b4595 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:10.256276 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aeb71-682a-4946-9f68-834db94b4595 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:10.257050 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aeb71-682a-4946-9f68-834db94b4595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:10.266311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aeb71-682a-4946-9f68-834db94b4595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:10.267766 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aeb71-682a-4946-9f68-834db94b4595 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:10.278245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1437/2845] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:15.201040 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:15.272307 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580ffc-11c5-479e-abde-603beb4ddc0b service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:15.277171 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:15.278209 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:15.278486 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:15.278757 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] PATH_INFO: `/v3/users/4c89e687a59b457c89388929d3a4a56b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:15.279988 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c89e687a59b457c89388929d3a4a56b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:15.281934 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:15.335251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c89e687a59b457c89388929d3a4a56b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.347251 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c89e687a59b457c89388929d3a4a56b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.347992 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c89e687a59b457c89388929d3a4a56b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.355501 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c89e687a59b457c89388929d3a4a56b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.363258 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c89e687a59b457c89388929d3a4a56b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.370058 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1409/2846] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:20:15 2022] DELETE /identity/v3/users/4c89e687a59b457c89388929d3a4a56b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:15.374648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:15.375166 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:15.375510 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:15.393978 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:15.395223 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:15.456718 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1438/2847] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:15.467088 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:15.468592 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:15.526797 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665add4-6862-442c-a381-d25062e8c8c5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:15.530543 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:15.531192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:15.531469 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:15.531781 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:15.542042 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:15.543479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:15.554441 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1410/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:15.839073 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:15.840622 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:15.853454 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8fb1-6fc5-4c67-ab43-62dc51e716a8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:15.858694 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:15.859541 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:15.859819 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:15.860093 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] PATH_INFO: `/v3/projects/10dd11b018aa441faa84b3bf087ce69b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:15.861306 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10dd11b018aa441faa84b3bf087ce69b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:15.863279 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:15.913650 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10dd11b018aa441faa84b3bf087ce69b', 'request_id': 'req-a6d6099c-7542-49c1-ba25-60812d720d8b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.921473 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10dd11b018aa441faa84b3bf087ce69b', 'request_id': 'req-a6d6099c-7542-49c1-ba25-60812d720d8b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.928245 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10dd11b018aa441faa84b3bf087ce69b', 'request_id': 'req-a6d6099c-7542-49c1-ba25-60812d720d8b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.938596 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] The token cache is being invalidate because project 10dd11b018aa441faa84b3bf087ce69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:20:15.938875 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.939534 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:15.941108 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1439/2849] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:20:15 2022] DELETE /identity/v3/projects/10dd11b018aa441faa84b3bf087ce69b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:15.945306 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:15.955050 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5bc61-e3b7-4674-8716-ee90cc92b69e service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.013015 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.013933 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.014219 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.014496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] PATH_INFO: `/v3/users/cf3938e0200f4a9abe1937e840df959f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.015711 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3938e0200f4a9abe1937e840df959f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.017683 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.064350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3938e0200f4a9abe1937e840df959f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.076866 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3938e0200f4a9abe1937e840df959f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.077651 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3938e0200f4a9abe1937e840df959f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.084489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3938e0200f4a9abe1937e840df959f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.092802 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-42841aba-38ff-4df0-bc2c-a10bf9baf622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3938e0200f4a9abe1937e840df959f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.099166 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1411/2850] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:20:15 2022] DELETE /identity/v3/users/cf3938e0200f4a9abe1937e840df959f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:16.384481 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.386411 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:16.401498 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6099c-7542-49c1-ba25-60812d720d8b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.460981 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.461789 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.462074 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.462348 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] PATH_INFO: `/v3/projects/e785f7432b98459d93f750fea7c3674f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.463569 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e785f7432b98459d93f750fea7c3674f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.465523 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.512900 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e785f7432b98459d93f750fea7c3674f', 'request_id': 'req-1c011798-7c3a-4bca-91c7-6f5eefda22d7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.527484 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e785f7432b98459d93f750fea7c3674f', 'request_id': 'req-1c011798-7c3a-4bca-91c7-6f5eefda22d7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.534479 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e785f7432b98459d93f750fea7c3674f', 'request_id': 'req-1c011798-7c3a-4bca-91c7-6f5eefda22d7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.546428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] The token cache is being invalidate because project e785f7432b98459d93f750fea7c3674f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:20:16.546715 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.547390 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1c011798-7c3a-4bca-91c7-6f5eefda22d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:16.548972 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1440/2851] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:20:16 2022] DELETE /identity/v3/projects/e785f7432b98459d93f750fea7c3674f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:16.555426 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.556038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.556156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.573737 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:16.574948 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:16.650037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1412/2852] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:16.659115 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.659400 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.659677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.680601 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:16.681883 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:16.690088 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1441/2853] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:16.694484 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.704184 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6d4f1-26ae-4f55-a8cf-76124da5b5c8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.708719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.709377 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.710185 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.710456 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.711226 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:20:16.711479 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.713064 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.724846 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1413/2854] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:20:16.730294 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.739502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533e511-5114-4b51-8df8-6f5147bf0e6f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.744123 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.744773 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.745051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.745323 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.746052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.747952 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.778581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1442/2855] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:20:16 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 14:20:16.783422 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.793742 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da527-e369-4ea6-bd51-f169dd95c9ab admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.852478 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.853150 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.853434 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.853740 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.854438 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.856368 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.876350 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1414/2856] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:20:16 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:16.880575 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.891460 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85ad1-1b27-4663-8fe3-eec3b8255f70 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.896051 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.896712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.896992 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.897876 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.898602 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.900244 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.912326 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1443/2857] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:16.916544 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.926837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37a4f3-006d-4d04-856b-b26e12ed7c33 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.931647 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89064-ae62-4dd2-87e2-380b3ab706fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.932317 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89064-ae62-4dd2-87e2-380b3ab706fa admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.932597 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89064-ae62-4dd2-87e2-380b3ab706fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.932872 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89064-ae62-4dd2-87e2-380b3ab706fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.933659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89064-ae62-4dd2-87e2-380b3ab706fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.935268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89064-ae62-4dd2-87e2-380b3ab706fa admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:16.946465 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1415/2858] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:16.951507 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:16.962372 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7de05-4969-4269-baa3-b56a9aef2b88 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:16.967021 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:16.967926 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:16.968210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:16.968487 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] PATH_INFO: `/v3/projects/36b2dc9dbec3438692da4034938ff7df/users/b44dbdfe63804df2adad68ae3ec14740/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:16.987188 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b2dc9dbec3438692da4034938ff7df, user_id=b44dbdfe63804df2adad68ae3ec14740, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:16.989935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:17.007772 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1444/2859] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:16 2022] PUT /identity/v3/projects/36b2dc9dbec3438692da4034938ff7df/users/b44dbdfe63804df2adad68ae3ec14740/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:17.020608 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:17.020901 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:17.021192 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:17.049095 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] MFA Rules not processed for user `b44dbdfe63804df2adad68ae3ec14740`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:17.050366 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:17.117963 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1416/2860] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:17.129680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:17.131401 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:17.193571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99360f24-e67f-4f0c-b793-45be42912960 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:17.198000 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e8f7-b457-44b9-a261-dfb44896287c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:17.198651 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e8f7-b457-44b9-a261-dfb44896287c service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:17.198935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e8f7-b457-44b9-a261-dfb44896287c service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:17.199210 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e8f7-b457-44b9-a261-dfb44896287c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:17.209571 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e8f7-b457-44b9-a261-dfb44896287c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:17.211102 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e8f7-b457-44b9-a261-dfb44896287c service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:17.220697 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1445/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:34.875545 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:34.940069 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb283f-7a83-4841-b957-bd7a771214e4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:34.945155 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:34.946084 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:34.946360 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:34.946632 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] PATH_INFO: `/v3/users/b44dbdfe63804df2adad68ae3ec14740` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:34.947985 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44dbdfe63804df2adad68ae3ec14740)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:34.950057 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:35.010913 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44dbdfe63804df2adad68ae3ec14740'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.022369 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44dbdfe63804df2adad68ae3ec14740'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.023792 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44dbdfe63804df2adad68ae3ec14740'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.031257 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44dbdfe63804df2adad68ae3ec14740'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.039207 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44dbdfe63804df2adad68ae3ec14740'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.045799 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1417/2862] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:20:34 2022] DELETE /identity/v3/users/b44dbdfe63804df2adad68ae3ec14740 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:35.050504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.051052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.051052 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.068949 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:35.070181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:35.129962 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1446/2863] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:35.139659 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:35.141085 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:35.205128 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20001b-8151-43b0-9d87-9daa56584299 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:35.208843 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48445ce8-04b2-4c20-aabb-58536eb3855c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:35.209496 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48445ce8-04b2-4c20-aabb-58536eb3855c service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.209837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48445ce8-04b2-4c20-aabb-58536eb3855c service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.210612 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48445ce8-04b2-4c20-aabb-58536eb3855c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.222634 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48445ce8-04b2-4c20-aabb-58536eb3855c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:35.224076 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48445ce8-04b2-4c20-aabb-58536eb3855c service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:35.234661 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1418/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:20:35.526559 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:35.527916 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:35.542069 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d929ad-df12-4f69-99e7-03d7453e76ab None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:35.554671 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:35.555885 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.556002 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.556312 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] PATH_INFO: `/v3/projects/36b2dc9dbec3438692da4034938ff7df` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.558017 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b2dc9dbec3438692da4034938ff7df)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:35.560500 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:35.610150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b2dc9dbec3438692da4034938ff7df', 'request_id': 'req-85ba39bf-0410-413e-9866-77e05104fd86'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.618285 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b2dc9dbec3438692da4034938ff7df', 'request_id': 'req-85ba39bf-0410-413e-9866-77e05104fd86'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.624856 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b2dc9dbec3438692da4034938ff7df', 'request_id': 'req-85ba39bf-0410-413e-9866-77e05104fd86'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.635428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] The token cache is being invalidate because project 36b2dc9dbec3438692da4034938ff7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:20:35.635648 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.636263 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85ba39bf-0410-413e-9866-77e05104fd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:20:35.637896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1447/2865] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:20:35 2022] DELETE /identity/v3/projects/36b2dc9dbec3438692da4034938ff7df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:20:35.643798 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.644080 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.644349 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.673133 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:35.674614 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:35.743215 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1419/2866] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 14:20:35.751142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.751429 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.751704 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.775215 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:35.776702 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:35.786344 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1448/2867] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:35.790886 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:35.800812 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a078d7-e0d8-4cef-9b73-88063187876b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:35.805428 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:35.806145 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.806425 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.806701 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.807430 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 14:20:35.807735 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:35.809333 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:35.821779 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1420/2868] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Apr 28 14:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 14:20:35.826181 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:35.836150 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69d0e1-bc1b-4660-9f53-89eb64a5f06c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:35.841412 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:35.842144 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.842490 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.842833 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.843723 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:35.846177 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:35.877504 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1449/2869] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Apr 28 14:20:35 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:35.881692 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:35.892436 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e048-41c1-4b54-844a-8a05faa03af1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:35.952990 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:35.953705 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.953991 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.954268 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.954965 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:35.956896 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:35.980442 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1421/2870] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Apr 28 14:20:35 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 14:20:35.981680 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:35.992511 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef120f-89c1-4c68-99d2-596a748de878 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:35.997417 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:35.998311 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:35.998452 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:35.998699 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:35.999712 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:36.001062 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:36.012521 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1450/2871] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:36.017007 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:36.030626 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ad52-3c49-4630-be1f-9278e131e32f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:36.035528 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dc5f5-aa8b-48ac-ab30-37fbdd74ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:36.036205 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc5f5-aa8b-48ac-ab30-37fbdd74ad77 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:36.036489 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc5f5-aa8b-48ac-ab30-37fbdd74ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:36.036766 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc5f5-aa8b-48ac-ab30-37fbdd74ad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:36.037493 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dc5f5-aa8b-48ac-ab30-37fbdd74ad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:36.039746 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dc5f5-aa8b-48ac-ab30-37fbdd74ad77 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:36.052288 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1422/2872] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Apr 28 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 14:20:36.054737 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:36.064810 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e4c3-44ab-478e-82d1-aa55a786765a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:36.069472 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:36.070398 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:36.070677 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:36.070947 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] PATH_INFO: `/v3/projects/27373fcd01064d4da019681614e17069/users/38b35e2df25e43a08b8e7bbc5cc35112/roles/ebb9c3282d21483bba8630dd78798d6b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:36.088674 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27373fcd01064d4da019681614e17069, user_id=38b35e2df25e43a08b8e7bbc5cc35112, role_id=ebb9c3282d21483bba8630dd78798d6b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:36.096821 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:36.118933 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1451/2873] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Apr 28 14:20:36 2022] PUT /identity/v3/projects/27373fcd01064d4da019681614e17069/users/38b35e2df25e43a08b8e7bbc5cc35112/roles/ebb9c3282d21483bba8630dd78798d6b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 14:20:36.130644 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:36.130929 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:36.131204 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:36.163060 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] MFA Rules not processed for user `38b35e2df25e43a08b8e7bbc5cc35112`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:20:36.164768 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:36.230808 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1423/2874] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:20:36.242428 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:20:36.244269 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:20:36.308259 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5bac0-dc99-460e-a8b2-7ea320e3586d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:20:36.311943 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cdbfc-747b-4903-93ce-0ec8855aa86c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562f710be70f4e11a67dc65b1adb5c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:20:36.312589 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cdbfc-747b-4903-93ce-0ec8855aa86c service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:20:36.312866 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cdbfc-747b-4903-93ce-0ec8855aa86c service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:20:36.313139 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cdbfc-747b-4903-93ce-0ec8855aa86c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:20:36.322493 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cdbfc-747b-4903-93ce-0ec8855aa86c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:20:36.323929 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cdbfc-747b-4903-93ce-0ec8855aa86c service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:20:36.333119 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1452/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:20:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:21:08.588719 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:21:08.649499 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2240048-8032-4de0-ba2d-65196d14f015 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:21:08.654457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:21:08.655321 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:21:08.655715 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:21:08.655991 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] PATH_INFO: `/v3/users/38b35e2df25e43a08b8e7bbc5cc35112` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:21:08.657163 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b35e2df25e43a08b8e7bbc5cc35112)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:21:08.659309 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:21:08.703731 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b35e2df25e43a08b8e7bbc5cc35112'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:08.714884 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b35e2df25e43a08b8e7bbc5cc35112'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:08.715546 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b35e2df25e43a08b8e7bbc5cc35112'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:08.721959 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b35e2df25e43a08b8e7bbc5cc35112'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:08.729618 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b35e2df25e43a08b8e7bbc5cc35112'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:08.735837 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1424/2876] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Apr 28 14:21:08 2022] DELETE /identity/v3/users/38b35e2df25e43a08b8e7bbc5cc35112 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:21:08.740408 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:21:08.740996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:21:08.740996 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:21:08.758340 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] MFA Rules not processed for user `345cf70d7bbb49b087ec3309f4fef536`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 14:21:08.760238 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:21:08.819689 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1453/2877] 10.222.0.20 () {58 vars in 957 bytes} [Thu Apr 28 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 14:21:08.829475 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:21:08.831037 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:21:08.832581 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:21:08.833935 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:21:08.890649 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f4d0d-db24-4d87-bb85-54a3e934fa98 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:21:08.894417 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049e46a723a24775a734834e57535201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:21:08.895073 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:21:08.895359 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:21:08.895635 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:21:08.905156 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:21:08.906663 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:21:08.916176 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1425/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 14:21:08.924502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e6fa-1f6e-4158-969b-b3146b649ab9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:21:08.930246 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:21:08.930896 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:21:08.931175 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:21:08.931449 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:21:08.933241 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:21:08.945502 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:21:08.947271 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:21:08.957964 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1454/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 14:21:09.206019 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:21:09.207457 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:21:09.222645 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d60176-55c4-4374-a2fe-97c44fdfe88d service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:21:09.227470 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345cf70d7bbb49b087ec3309f4fef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3a0706a2a19418486859792dfa920d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:21:09.228432 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:21:09.228720 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:21:09.228993 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] PATH_INFO: `/v3/projects/27373fcd01064d4da019681614e17069` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:21:09.230193 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27373fcd01064d4da019681614e17069)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:21:09.232091 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:21:09.278276 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27373fcd01064d4da019681614e17069', 'request_id': 'req-8577de77-7284-4cbf-9758-4fc99c977b48'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:09.288072 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27373fcd01064d4da019681614e17069', 'request_id': 'req-8577de77-7284-4cbf-9758-4fc99c977b48'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:09.294784 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27373fcd01064d4da019681614e17069', 'request_id': 'req-8577de77-7284-4cbf-9758-4fc99c977b48'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:09.305752 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] The token cache is being invalidate because project 27373fcd01064d4da019681614e17069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 14:21:09.306038 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:09.306713 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8577de77-7284-4cbf-9758-4fc99c977b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 14:21:09.308252 dv-cinder-839760-1-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1426/2880] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Apr 28 14:21:09 2022] DELETE /identity/v3/projects/27373fcd01064d4da019681614e17069 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 14:26:12.773036 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 14:26:12.774886 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:26:12.790107 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd08175-4a6d-4dfc-9e31-fd83e1bdf779 service placement] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 14:26:12.850120 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590c10bbd98b4dabbb7c35d389bf7e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70d95cf5ee1f45159b8b09db6f5a8345', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 14:26:12.850762 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 14:26:12.851067 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 14:26:12.851347 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 14:26:12.853142 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 14:26:12.865110 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 14:26:12.866698 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12872844-e8c4-4498-8541-7996b285fcb8 service placement] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 14:26:12.876970 dv-cinder-839760-1-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1455/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Apr 28 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)